[ 520.193600] env[66041]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 520.193600] env[66041]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 521.184384] env[66131]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.184384] env[66131]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.739439] env[66131]: INFO neutron.common.config [-] Logging enabled! [ 522.739698] env[66131]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev31 [ 522.740016] env[66131]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66131) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 522.740298] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 522.740391] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 522.741224] env[66131]: WARNING oslo_policy.policy [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 522.741441] env[66131]: WARNING oslo_policy.policy [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 522.743105] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] VMware NSXv3 Agent initialized successfully. [ 522.743458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] Acquiring lock "singleton_lock" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.743585] env[66131]: DEBUG oslo_concurrency.lockutils [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] Acquired lock "singleton_lock" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.743797] env[66131]: DEBUG oslo_concurrency.lockutils [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] Releasing lock "singleton_lock" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.744091] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] Full set of CONF: {{(pid=66131) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 522.744213] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ******************************************************************************** {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 522.744325] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] Configuration options gathered from: {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 522.744675] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 522.744851] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 522.744965] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ================================================================================ {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 522.745172] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] agent_down_time = 75 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.745321] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] allow_automatic_dhcp_failover = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.745467] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] allow_bulk = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.745622] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] api_extensions_path = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.745771] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] api_paste_config = api-paste.ini {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.745922] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] auth_strategy = keystone {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746047] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] backdoor_port = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746156] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] backdoor_socket = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746296] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] backlog = 4096 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746435] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746593] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] bind_host = 0.0.0.0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746731] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] bind_port = 9696 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.746863] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] client_socket_timeout = 900 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747008] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] config_dir = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747119] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747255] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] config_source = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747412] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] control_exchange = neutron {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747563] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] core_plugin = ml2 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747698] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] debug = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.747832] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] default_availability_zones = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748041] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748182] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] dhcp_agent_notification = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748314] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] dhcp_agents_per_network = 1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748447] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] dhcp_lease_duration = 86400 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748587] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] dhcp_load_type = networks {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748719] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] dns_domain = openstacklocal {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748852] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.748981] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_default_route_bfd = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749119] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_default_route_ecmp = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749244] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_dvr = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749397] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_new_agents = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749551] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749659] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_signals = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749787] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] enable_traditional_dhcp = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.749909] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] external_dns_driver = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750090] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] filter_validation = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750179] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] global_physnet_mtu = 8950 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750299] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] graceful_shutdown_timeout = 60 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750474] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] host = cpu-1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750608] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] host_dvr_for_dhcp = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750738] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] http_retries = 3 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.750880] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] instance_format = [instance: %(uuid)s] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751025] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751167] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ipam_driver = internal {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751297] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ipv6_pd_enabled = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751427] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] l3_ha = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751565] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751707] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] l3_ha_network_physical_name = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751833] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] l3_ha_network_type = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.751969] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_color = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752112] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_config_append = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752247] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752375] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_dir = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752503] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_file = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752602] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_options = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752732] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_rotate_interval = 1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.752869] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_rotate_interval_type = days {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753009] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] log_rotation_type = none {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753116] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753215] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753356] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753488] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753585] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753742] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] max_dns_nameservers = 5 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753849] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] max_header_line = 16384 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.753976] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] max_l3_agents_per_router = 3 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754116] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] max_logfile_count = 30 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754242] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] max_logfile_size_mb = 200 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754367] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] max_subnet_host_routes = 20 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754500] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] my_ip = 10.180.1.21 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754631] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] my_ipv6 = ::1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754794] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] network_auto_schedule = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.754933] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] network_link_prefix = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755087] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755227] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] notify_nova_on_port_data_changes = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755361] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] notify_nova_on_port_status_changes = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755499] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] pagination_max_limit = -1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755627] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] publish_errors = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755753] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] rate_limit_burst = 0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.755886] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] rate_limit_except_level = CRITICAL {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756019] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] rate_limit_interval = 0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756150] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] retry_until_window = 30 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756277] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] router_distributed = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756405] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] rpc_resources_processing_step = 20 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756532] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] rpc_response_max_timeout = 600 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756659] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] rpc_response_timeout = 60 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756783] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] send_events_interval = 2 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.756925] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] service_plugins = ['router'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757068] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] setproctitle = on {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757194] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] shell_completion = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757359] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] state_path = /opt/stack/data/neutron {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757514] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] syslog_log_facility = LOG_USER {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757645] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] tcp_keepidle = 600 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757779] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] transport_url = **** {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.757908] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] use_journal = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758046] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] use_json = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758173] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] use_ssl = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758297] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] use_stderr = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758430] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] use_syslog = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758554] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] vlan_qinq = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758677] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] vlan_transparent = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758802] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] watch_log_file = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.758927] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] wsgi_default_pool_size = 100 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.759062] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] wsgi_keep_alive = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.759197] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.759324] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] wsgi_server_debug = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.759501] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_concurrency.disable_process_locking = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.759650] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.759792] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.759925] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760076] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760219] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760369] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760531] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.connection_string = messaging:// {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760670] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.enabled = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760810] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.es_doc_type = notification {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.760943] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.es_scroll_size = 10000 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761094] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.es_scroll_time = 2m {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761228] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.filter_error_trace = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761365] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.hmac_keys = **** {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761501] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.sentinel_service_name = mymaster {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761644] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.socket_timeout = 0.1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761775] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.trace_requests = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.761905] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler.trace_sqlalchemy = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.762063] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler_jaeger.process_tags = {} {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.762197] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler_jaeger.service_name_prefix = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.762330] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] profiler_otlp.service_name_prefix = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.762478] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.enforce_new_defaults = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.762749] env[66131]: WARNING oslo_config.cfg [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 522.762900] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.enforce_scope = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763055] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.policy_default_rule = default {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763207] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763349] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763491] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763622] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763755] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.763878] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764013] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764156] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764301] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764444] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] agent.extensions = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764585] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764723] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] service_providers.service_provider = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.764863] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.default_quota = -1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765009] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765150] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_floatingip = 50 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765283] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_network = 100 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765416] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_port = 500 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765546] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765675] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_router = 10 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765803] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_security_group = 10 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.765934] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766073] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.quota_subnet = 100 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766206] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] QUOTAS.track_quota_usage = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766353] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766486] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.group = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766615] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.helper_command = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766755] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.log_daemon_traceback = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.766915] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767063] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.thread_pool_size = 8 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767199] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep.user = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767343] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767474] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.group = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767601] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.helper_command = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767728] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767866] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.767991] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768130] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_dhcp_release.user = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768267] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768396] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.group = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768524] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768651] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768783] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.768914] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769051] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_ovs_vsctl.user = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769189] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.capabilities = [21] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769315] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.group = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769471] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.helper_command = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769608] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769743] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.769876] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770021] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_namespace.user = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770154] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.capabilities = [12] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770319] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.group = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770413] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.helper_command = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770560] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770701] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770835] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.770962] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_conntrack.user = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771114] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.capabilities = [12, 21] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771242] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.group = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771366] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.helper_command = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771498] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.log_daemon_traceback = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771632] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771762] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.thread_pool_size = 8 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.771888] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] privsep_link.user = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772047] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772192] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772327] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.continue_on_failed_promotions = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772457] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.dscp = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772593] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.dscp_inherit = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772731] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.force_mp_to_policy = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772864] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.locking_coordinator_url = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.772997] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.log_agent_heartbeats = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773140] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.logging_expire = 1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773278] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773410] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773548] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.polling_interval = 240 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773679] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773814] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.773952] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.report_interval = 30.0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774113] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774255] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774391] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774529] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.sync_skew = 60 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774661] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.synchronization_queue_size = 20 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774792] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT.use_helper_for_ns_read = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.774927] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] SECURITYGROUP.enable_ipset = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775077] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] SECURITYGROUP.enable_security_group = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775217] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775355] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775498] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] experimental.ipv6_pd_enabled = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775648] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.extension_drivers = ['port_security'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775784] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.external_network_type = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.775926] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776081] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.overlay_ip_version = 4 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776221] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.path_mtu = 8950 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776359] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.physical_network_mtus = {} {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776500] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776637] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776777] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ml2.type_drivers = ['vlan'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.776918] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777059] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777195] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777337] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777506] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777651] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777790] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.777928] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778076] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778277] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778424] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_login_password = **** {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778567] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778702] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_login_user = admin {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778839] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.778976] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779122] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779254] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779427] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779574] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779712] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779847] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.779980] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.780132] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.780273] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.780442] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.780538] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.780725] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.780870] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781016] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781154] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781290] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.auth_section = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781435] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.auth_type = password {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781575] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781706] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.certfile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781836] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.collect_timing = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.781974] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.endpoint_type = public {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782118] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.insecure = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782245] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.keyfile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782384] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.region_name = RegionOne {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782517] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.split_loggers = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782645] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] nova.timeout = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782779] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.auth_section = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.782920] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.auth_type = password {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783067] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783198] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.certfile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783327] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.collect_timing = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783464] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.endpoint_type = public {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783595] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.insecure = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783718] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.keyfile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783842] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.region_name = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.783965] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.split_loggers = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784100] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] placement.timeout = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784236] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.auth_section = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784365] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.auth_type = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784494] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.cafile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784618] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.certfile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784746] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.collect_timing = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784871] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.connect_retries = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.784996] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.connect_retry_delay = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785136] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.enable_notifications = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785261] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.endpoint_override = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785389] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.insecure = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785514] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.interface = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785642] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.keyfile = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785772] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.max_version = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.785896] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.min_version = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786031] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.region_name = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786161] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.retriable_status_codes = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786287] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.service_name = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786412] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.service_type = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786539] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.split_loggers = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786660] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.status_code_retries = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786784] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.status_code_retry_delay = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.786910] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.timeout = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787044] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.valid_interfaces = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787172] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ironic.version = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787306] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] cli_script.dry_run = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787475] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787613] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787745] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.787873] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788007] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788143] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788270] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788398] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788528] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788665] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788793] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.788927] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789071] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789205] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789336] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789528] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789676] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789811] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.789950] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790094] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790229] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790361] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790565] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790635] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790741] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790867] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.790994] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791139] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791267] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791396] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791529] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.ssl = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791668] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791803] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.791934] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792086] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792223] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792362] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792514] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_notifications.driver = [] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792648] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_notifications.retry = -1 {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792794] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.792922] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.793031] env[66131]: DEBUG oslo_service.backend._eventlet.service [None req-4eabad47-89dd-4b41-bf82-90f85478f586 None None] ******************************************************************************** {{(pid=66131) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 522.794171] env[66131]: DEBUG neutron.agent.securitygroups_rpc [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Init firewall settings (driver=nsxv3) {{(pid=66131) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 522.795513] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66131) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 522.795754] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] RPC agent_id: nsxm-l-01a.corp.local [ 522.797957] env[66131]: DEBUG dogpile.cache.region [None req-5004a8f5-9220-484d-9816-181324c52cea None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 522.798090] env[66131]: DEBUG dogpile.lock [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 522.798190] env[66131]: DEBUG dogpile.lock [None req-5004a8f5-9220-484d-9816-181324c52cea None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 522.798279] env[66131]: DEBUG dogpile.lock [None req-5004a8f5-9220-484d-9816-181324c52cea None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 522.798371] env[66131]: DEBUG dogpile.cache.region [None req-5004a8f5-9220-484d-9816-181324c52cea None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 522.798458] env[66131]: DEBUG dogpile.lock [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 522.798582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 522.833678] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Session token - acquiring [ 522.835651] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.835873] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.835943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.836393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.847544] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.111219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 523.132106] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 523.132257] env[66131]: DEBUG dogpile.cache.region [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Cache value generated in 0.334 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 523.132363] env[66131]: DEBUG dogpile.lock [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 523.132481] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Activating Policy API Provider. [ 523.134111] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Looking for the default Infrastructure Rules. [ 523.203196] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Looking for the Default Layer3 Logged Drop Section. [ 523.218758] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 523.219287] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.219518] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.219623] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.219910] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 523.220260] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-5004a8f5-9220-484d-9816-181324c52cea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.736564] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-5004a8f5-9220-484d-9816-181324c52cea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.239752] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-5004a8f5-9220-484d-9816-181324c52cea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.742345] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Inventory metadata is going to be refreshed. [ 524.742588] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 525.569424] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.569857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.569857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.570094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.582264] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 525.583218] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.583821] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 525.604086] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.604336] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.604378] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.604652] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.604774] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.604920] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 525.605080] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.605202] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 525.627082] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.627297] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.627431] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.627721] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.627900] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.628055] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 525.649131] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.649503] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.649503] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.649747] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.649896] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.650072] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 525.670163] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.670416] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.670416] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.670723] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.670867] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.671025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 525.671130] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.671231] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 525.690935] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.691164] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.691222] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.691494] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.691620] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.691762] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 525.691862] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.691963] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 525.713044] env[66131]: DEBUG networking_nsxv3.common.locking [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.713307] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.713436] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.713731] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.713875] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.714038] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 525.714146] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.714242] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Inventory metadata have been refreshed. [ 525.714337] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Dryrun:True. Metadata refresh completed. [ 525.714450] env[66131]: DEBUG oslo_concurrency.lockutils [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Releasing lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.716233] env[66131]: INFO neutron.agent.agent_extensions_manager [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Loaded agent extensions: [] [ 525.717572] env[66131]: DEBUG neutron_lib.callbacks.manager [None req-5004a8f5-9220-484d-9816-181324c52cea None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66131) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 525.764591] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent RPC Daemon Started! [ 525.764820] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:0 started [ 525.764820] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent out of sync with plugin! [ 530.717986] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 530.718430] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 535.720346] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.720346] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.711631] env[66131]: INFO networking_nsxv3.common.synchronization [None req-087dab40-d026-41c8-94d8-557db207dedf demo admin] Enqueued Resource ID: d4695c51-f6c4-47f3-8e31-a692be8e8eae with Priority: HIGHEST for action security_group_rules [ 540.711864] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4695c51-f6c4-47f3-8e31-a692be8e8eae with Priority: HIGHEST for action security_group_rules [ 540.712225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4695c51-f6c4-47f3-8e31-a692be8e8eae taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.712386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4695c51-f6c4-47f3-8e31-a692be8e8eae" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.712476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4695c51-f6c4-47f3-8e31-a692be8e8eae" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.712830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4695c51-f6c4-47f3-8e31-a692be8e8eae" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.712946] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4695c51-f6c4-47f3-8e31-a692be8e8eae',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.233311] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.233627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.233627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.233774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.233826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.233896] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4695c51-f6c4-47f3-8e31-a692be8e8eae already deleted. [ 541.233978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4695c51-f6c4-47f3-8e31-a692be8e8eae" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.713681] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.713681] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.714546] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.714778] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.715523] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.716309] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.717988] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.718759] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.720365] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.722423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.722423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.722423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.722423] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.225267] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.730907] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.234537] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 564.234717] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 564.922645] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e0a3391f-dce9-43b9-872d-5f6d2d2ab3b0 None None] Enqueued Resource ID: 312b1804-9670-4eb5-917a-e52e72100609 with Priority: HIGHEST for action port [ 564.931740] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 312b1804-9670-4eb5-917a-e52e72100609 with Priority: HIGHEST for action port [ 564.933809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-312b1804-9670-4eb5-917a-e52e72100609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.933809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-312b1804-9670-4eb5-917a-e52e72100609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.933809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-312b1804-9670-4eb5-917a-e52e72100609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.933809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-312b1804-9670-4eb5-917a-e52e72100609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.933809] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('312b1804-9670-4eb5-917a-e52e72100609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.991232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.992382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.992382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.992382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.004154] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 565.006585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.007394] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 565.027822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.028038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.028128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.028326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.028391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.028455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 565.028524] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.028584] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 565.050302] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.050520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.050520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.050725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.050839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.050969] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 565.074058] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.074213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.074315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.074482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.074584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.074691] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 565.096490] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.096591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.096630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.096811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.096916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.097048] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 565.097147] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.097233] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 565.114733] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.114930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.114930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.115168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.115255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.115463] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 565.115463] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.115589] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 565.139432] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.139599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.139671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.139900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.140097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.140278] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 565.140356] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.140424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 565.140490] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 565.140653] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 565.140653] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 565.140735] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 565.140950] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 565.141031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 565.141100] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 565.162621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.162621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.162621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.162621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.162873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.162873] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 565.186096] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.186280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.186332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.186524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.186630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.201310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.435593] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 312b1804-9670-4eb5-917a-e52e72100609 [ 565.435818] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.435948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.438079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.438079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.438079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.438079] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:312b1804-9670-4eb5-917a-e52e72100609 already deleted. [ 565.438079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-312b1804-9670-4eb5-917a-e52e72100609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.643647] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6c3e35fd-50a3-4646-8634-cf7977b26fcc None None] Enqueued Resource ID: 3657efe3-4c02-4e84-b056-50b739ac440f with Priority: HIGHEST for action port [ 566.644167] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3657efe3-4c02-4e84-b056-50b739ac440f with Priority: HIGHEST for action port [ 566.644468] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3657efe3-4c02-4e84-b056-50b739ac440f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.644594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3657efe3-4c02-4e84-b056-50b739ac440f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.644663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3657efe3-4c02-4e84-b056-50b739ac440f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.644920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3657efe3-4c02-4e84-b056-50b739ac440f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.645017] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3657efe3-4c02-4e84-b056-50b739ac440f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.147590] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3657efe3-4c02-4e84-b056-50b739ac440f [ 567.147811] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.147958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.148048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.148276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.148366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.148464] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3657efe3-4c02-4e84-b056-50b739ac440f already deleted. [ 567.148545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3657efe3-4c02-4e84-b056-50b739ac440f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.645906] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.646331] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.830989] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e2adf9dc-c96e-465b-a51e-1e629b3aa3c8 None None] Enqueued Resource ID: 30df274f-4044-4ccf-b88a-fb9cf5ded55b with Priority: HIGHEST for action port [ 571.830989] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30df274f-4044-4ccf-b88a-fb9cf5ded55b with Priority: HIGHEST for action port [ 571.830989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-30df274f-4044-4ccf-b88a-fb9cf5ded55b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.831189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30df274f-4044-4ccf-b88a-fb9cf5ded55b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.831189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30df274f-4044-4ccf-b88a-fb9cf5ded55b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.831412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30df274f-4044-4ccf-b88a-fb9cf5ded55b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.831486] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30df274f-4044-4ccf-b88a-fb9cf5ded55b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.313133] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ffcac437-b683-4b65-826b-ff766b1c91bb None None] Enqueued Resource ID: c1fff81b-e484-423f-b200-e8618bf48c51 with Priority: HIGHEST for action port [ 572.313133] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1fff81b-e484-423f-b200-e8618bf48c51 with Priority: HIGHEST for action port [ 572.313133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1fff81b-e484-423f-b200-e8618bf48c51 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.313133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1fff81b-e484-423f-b200-e8618bf48c51" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.313133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1fff81b-e484-423f-b200-e8618bf48c51" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.313133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1fff81b-e484-423f-b200-e8618bf48c51" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.313133] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1fff81b-e484-423f-b200-e8618bf48c51',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.334676] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30df274f-4044-4ccf-b88a-fb9cf5ded55b [ 572.334889] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.335041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.335110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.335648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.335648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.335648] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30df274f-4044-4ccf-b88a-fb9cf5ded55b already deleted. [ 572.335648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30df274f-4044-4ccf-b88a-fb9cf5ded55b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.816150] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1fff81b-e484-423f-b200-e8618bf48c51 [ 572.816530] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.816869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.816869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.817315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.817315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.817315] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1fff81b-e484-423f-b200-e8618bf48c51 already deleted. [ 572.817315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1fff81b-e484-423f-b200-e8618bf48c51" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.553188] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ddd5fe35-4a5b-46ea-a03e-ae3231f0c3a4 None None] Enqueued Resource ID: 363048b3-aadb-4c64-86da-7afbce90e9f0 with Priority: HIGHEST for action port [ 574.553467] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 363048b3-aadb-4c64-86da-7afbce90e9f0 with Priority: HIGHEST for action port [ 574.553879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-363048b3-aadb-4c64-86da-7afbce90e9f0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.554859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-363048b3-aadb-4c64-86da-7afbce90e9f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.554859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-363048b3-aadb-4c64-86da-7afbce90e9f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.554859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-363048b3-aadb-4c64-86da-7afbce90e9f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.554859] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('363048b3-aadb-4c64-86da-7afbce90e9f0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.735628] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5fd00745-831f-4c1f-9fcc-ff5d663c84ff None None] Enqueued Resource ID: 53de480e-485a-4282-9eda-b79ddbe4c338 with Priority: HIGHEST for action port [ 574.735628] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53de480e-485a-4282-9eda-b79ddbe4c338 with Priority: HIGHEST for action port [ 574.735628] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-53de480e-485a-4282-9eda-b79ddbe4c338 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.736415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53de480e-485a-4282-9eda-b79ddbe4c338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.736415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53de480e-485a-4282-9eda-b79ddbe4c338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.736415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53de480e-485a-4282-9eda-b79ddbe4c338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.736726] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53de480e-485a-4282-9eda-b79ddbe4c338',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.897781] env[66131]: INFO networking_nsxv3.common.synchronization [None req-dfa72aab-828f-43b0-9ae2-23422467b3d1 None None] Enqueued Resource ID: 6d37e58b-4663-4460-92fe-a4f8430f220a with Priority: HIGHEST for action port [ 574.898181] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d37e58b-4663-4460-92fe-a4f8430f220a with Priority: HIGHEST for action port [ 574.898532] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d37e58b-4663-4460-92fe-a4f8430f220a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.898655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d37e58b-4663-4460-92fe-a4f8430f220a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.898722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d37e58b-4663-4460-92fe-a4f8430f220a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.898970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d37e58b-4663-4460-92fe-a4f8430f220a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.899300] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d37e58b-4663-4460-92fe-a4f8430f220a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.059529] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 363048b3-aadb-4c64-86da-7afbce90e9f0 [ 575.059529] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.059529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.059529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.059529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.059529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.059529] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:363048b3-aadb-4c64-86da-7afbce90e9f0 already deleted. [ 575.059529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-363048b3-aadb-4c64-86da-7afbce90e9f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.240446] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53de480e-485a-4282-9eda-b79ddbe4c338 [ 575.240446] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.240446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.240446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.240446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.240446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.240446] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53de480e-485a-4282-9eda-b79ddbe4c338 already deleted. [ 575.240446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53de480e-485a-4282-9eda-b79ddbe4c338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.402602] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d37e58b-4663-4460-92fe-a4f8430f220a [ 575.403108] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.403422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.403422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.403582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.403671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.403785] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d37e58b-4663-4460-92fe-a4f8430f220a already deleted. [ 575.403869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d37e58b-4663-4460-92fe-a4f8430f220a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.465106] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ac93ac48-d56f-4c5c-82df-b5c03e3612af None None] Enqueued Resource ID: 3cae111d-2c4f-4c18-afb5-f16c61d6a4d9 with Priority: HIGHEST for action port [ 575.465384] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cae111d-2c4f-4c18-afb5-f16c61d6a4d9 with Priority: HIGHEST for action port [ 575.465990] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cae111d-2c4f-4c18-afb5-f16c61d6a4d9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.469701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cae111d-2c4f-4c18-afb5-f16c61d6a4d9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.469701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cae111d-2c4f-4c18-afb5-f16c61d6a4d9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.469701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cae111d-2c4f-4c18-afb5-f16c61d6a4d9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.469701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cae111d-2c4f-4c18-afb5-f16c61d6a4d9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.972965] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cae111d-2c4f-4c18-afb5-f16c61d6a4d9 [ 575.972965] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.972965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.972965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.972965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.972965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.972965] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cae111d-2c4f-4c18-afb5-f16c61d6a4d9 already deleted. [ 575.972965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cae111d-2c4f-4c18-afb5-f16c61d6a4d9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.461432] env[66131]: INFO networking_nsxv3.common.synchronization [None req-29855c97-1348-4689-b430-4e68d7edc508 tempest-ServersTestManualDisk-878576868 tempest-ServersTestManualDisk-878576868-project-member] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_rules [ 576.461432] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_rules [ 576.461777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.461948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.462073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.462281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.462368] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.984431] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.984728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.984728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.984929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.985029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.985126] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 already deleted. [ 576.985329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.439438] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5aa05d74-aeee-4ff6-a40f-965547aa5130 tempest-ServersTestManualDisk-878576868 tempest-ServersTestManualDisk-878576868-project-member] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_rules [ 577.439438] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_rules [ 577.439438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.441080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.441080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.441080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.441080] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.959836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.960054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.960171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.960359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.960454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.960548] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 already deleted. [ 577.960629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.149670] env[66131]: INFO networking_nsxv3.common.synchronization [None req-40ce127c-2e50-41fa-b6ce-a9f6bc26d237 None None] Enqueued Resource ID: da32de87-629b-491c-b6ae-f352b5b05045 with Priority: HIGHEST for action port [ 578.150361] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da32de87-629b-491c-b6ae-f352b5b05045 with Priority: HIGHEST for action port [ 578.150717] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-da32de87-629b-491c-b6ae-f352b5b05045 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.151312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da32de87-629b-491c-b6ae-f352b5b05045" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.151436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da32de87-629b-491c-b6ae-f352b5b05045" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.151714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da32de87-629b-491c-b6ae-f352b5b05045" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.151837] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da32de87-629b-491c-b6ae-f352b5b05045',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.485818] env[66131]: INFO networking_nsxv3.common.synchronization [None req-7b2c16e9-4b7b-46ed-a9e4-95eae25bcc9a None None] Enqueued Resource ID: 6ab49e70-8226-4275-b686-48a2bd4fa5d5 with Priority: HIGHEST for action port [ 578.486135] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab49e70-8226-4275-b686-48a2bd4fa5d5 with Priority: HIGHEST for action port [ 578.486411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab49e70-8226-4275-b686-48a2bd4fa5d5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.486537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab49e70-8226-4275-b686-48a2bd4fa5d5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.486605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab49e70-8226-4275-b686-48a2bd4fa5d5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.486858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab49e70-8226-4275-b686-48a2bd4fa5d5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.486953] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab49e70-8226-4275-b686-48a2bd4fa5d5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.655254] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da32de87-629b-491c-b6ae-f352b5b05045 [ 578.655478] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.655905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.655980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.656229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.656326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.656445] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da32de87-629b-491c-b6ae-f352b5b05045 already deleted. [ 578.656531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da32de87-629b-491c-b6ae-f352b5b05045" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.726825] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f3c4bd03-5512-4818-af75-c2b0832e540c None None] Enqueued Resource ID: 6baa5c5a-de3e-44d6-a594-38b4ff303c70 with Priority: HIGHEST for action port [ 578.727841] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baa5c5a-de3e-44d6-a594-38b4ff303c70 with Priority: HIGHEST for action port [ 578.727841] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6baa5c5a-de3e-44d6-a594-38b4ff303c70 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.728160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6baa5c5a-de3e-44d6-a594-38b4ff303c70" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.729176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6baa5c5a-de3e-44d6-a594-38b4ff303c70" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.729290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6baa5c5a-de3e-44d6-a594-38b4ff303c70" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.729370] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6baa5c5a-de3e-44d6-a594-38b4ff303c70',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.988758] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ab49e70-8226-4275-b686-48a2bd4fa5d5 [ 578.988974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.989733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.989733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.989733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.989733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.989733] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ab49e70-8226-4275-b686-48a2bd4fa5d5 already deleted. [ 578.989733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab49e70-8226-4275-b686-48a2bd4fa5d5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.231925] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6baa5c5a-de3e-44d6-a594-38b4ff303c70 [ 579.233473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.233473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.233473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.233473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.233473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.233473] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6baa5c5a-de3e-44d6-a594-38b4ff303c70 already deleted. [ 579.233473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6baa5c5a-de3e-44d6-a594-38b4ff303c70" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.781362] env[66131]: INFO networking_nsxv3.common.synchronization [None req-74d4e64f-af8f-46b7-8d8e-56ffa5f03726 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 579.784482] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 579.785740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.786690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.786779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.787025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.787511] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.900099] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ade539d4-05a7-414b-bcd5-b5eb9597a910 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 579.903298] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 579.903428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.903479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.298510] env[66131]: INFO networking_nsxv3.common.synchronization [None req-abeee25b-4a71-4308-b8f7-89815b812bf8 None None] Enqueued Resource ID: cbc06f0b-7f51-470a-b7e3-f58400634a81 with Priority: HIGHEST for action port [ 580.298772] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc06f0b-7f51-470a-b7e3-f58400634a81 with Priority: HIGHEST for action port [ 580.299111] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbc06f0b-7f51-470a-b7e3-f58400634a81 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.299251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbc06f0b-7f51-470a-b7e3-f58400634a81" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.299323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbc06f0b-7f51-470a-b7e3-f58400634a81" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.300626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbc06f0b-7f51-470a-b7e3-f58400634a81" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.300626] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbc06f0b-7f51-470a-b7e3-f58400634a81',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.309907] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.310126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.310182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.310355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.310484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.310531] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 already deleted. [ 580.310668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.310735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.310877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.310960] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.445298] env[66131]: INFO networking_nsxv3.common.synchronization [None req-b4d362db-e8d6-4b37-9fc7-1fd1ddf436b6 None None] Enqueued Resource ID: d6a3eb4c-794a-432f-8534-95d641ecbdac with Priority: HIGHEST for action port [ 580.446194] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a3eb4c-794a-432f-8534-95d641ecbdac with Priority: HIGHEST for action port [ 580.447154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6a3eb4c-794a-432f-8534-95d641ecbdac taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.448102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6a3eb4c-794a-432f-8534-95d641ecbdac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.448102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6a3eb4c-794a-432f-8534-95d641ecbdac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.448102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6a3eb4c-794a-432f-8534-95d641ecbdac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.448102] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a3eb4c-794a-432f-8534-95d641ecbdac',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.578335] env[66131]: INFO networking_nsxv3.common.synchronization [req-fddf794c-cdc8-45fb-8d38-44747bef1af4 req-db433d83-2bc3-46c3-98f0-62dfbf1db173 tempest-DeleteServersAdminTestJSON-1740667775 tempest-DeleteServersAdminTestJSON-1740667775-project-member] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 580.578395] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 580.581240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.581240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.581240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.582266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.582266] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.582266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.582266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.582478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.582508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.583218] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.804951] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbc06f0b-7f51-470a-b7e3-f58400634a81 [ 580.805515] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.805515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.805515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.805793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.805793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.805793] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbc06f0b-7f51-470a-b7e3-f58400634a81 already deleted. [ 580.805954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbc06f0b-7f51-470a-b7e3-f58400634a81" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.837241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.837484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.837484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.837764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.837764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.837880] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 already deleted. [ 580.837880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.949695] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6a3eb4c-794a-432f-8534-95d641ecbdac [ 580.949993] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.950086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.950601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.950601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.950601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.950601] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6a3eb4c-794a-432f-8534-95d641ecbdac already deleted. [ 580.950778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6a3eb4c-794a-432f-8534-95d641ecbdac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.085312] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.085482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.085554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.085773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.085866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.086068] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.086169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.086234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.086378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.086455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.086551] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf already deleted. [ 581.086611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.130867] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.131091] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.131243] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.131912] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.131912] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.132102] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.132172] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.132374] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.132512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.132778] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.133170] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 581.133170] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 581.133170] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 581.133312] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.133312] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 581.133534] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 581.152437] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 581.152596] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 581.152762] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 581.152942] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.153291] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-914559d0-7006-479d-a6be-a38ef6df4d68 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.153576] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.153707] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.154034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.154176] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914559d0-7006-479d-a6be-a38ef6df4d68',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.498187] env[66131]: INFO networking_nsxv3.common.synchronization [None req-471d4d9f-5a90-4270-970a-15663815108d None None] Enqueued Resource ID: 888f47a2-a008-47f0-a9dc-e8b0efea9dc4 with Priority: HIGHEST for action port [ 581.498932] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 888f47a2-a008-47f0-a9dc-e8b0efea9dc4 with Priority: HIGHEST for action port [ 581.499079] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-888f47a2-a008-47f0-a9dc-e8b0efea9dc4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.499550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-888f47a2-a008-47f0-a9dc-e8b0efea9dc4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.499550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-888f47a2-a008-47f0-a9dc-e8b0efea9dc4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.499550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-888f47a2-a008-47f0-a9dc-e8b0efea9dc4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.499550] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('888f47a2-a008-47f0-a9dc-e8b0efea9dc4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.658446] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.659038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.659038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.661060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.661060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.661060] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 914559d0-7006-479d-a6be-a38ef6df4d68 not found, creating... [ 581.661060] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.661060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.661060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.661060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.661502] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.662830] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.662830] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.662830] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.663083] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.663126] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.664115] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 914559d0-7006-479d-a6be-a38ef6df4d68 is going to be created. [ 581.688893] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.689205] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.689255] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.689496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.690422] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.691172] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.002113] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 888f47a2-a008-47f0-a9dc-e8b0efea9dc4 [ 582.002113] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.002288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.002288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.002751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.002751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.002751] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:888f47a2-a008-47f0-a9dc-e8b0efea9dc4 already deleted. [ 582.002751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-888f47a2-a008-47f0-a9dc-e8b0efea9dc4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.562507] env[66131]: INFO networking_nsxv3.common.synchronization [req-fddf794c-cdc8-45fb-8d38-44747bef1af4 req-33e7614a-0bc0-43e0-a99d-4940b4c1f4b8 service nova] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_rules [ 582.562507] env[66131]: INFO networking_nsxv3.common.synchronization [req-fddf794c-cdc8-45fb-8d38-44747bef1af4 req-33e7614a-0bc0-43e0-a99d-4940b4c1f4b8 service nova] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 582.562507] env[66131]: INFO networking_nsxv3.common.synchronization [req-fddf794c-cdc8-45fb-8d38-44747bef1af4 req-33e7614a-0bc0-43e0-a99d-4940b4c1f4b8 service nova] Enqueued Resource ID: 914559d0-7006-479d-a6be-a38ef6df4d68 with Priority: HIGHEST for action port [ 582.563420] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_rules [ 582.563420] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 582.563420] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914559d0-7006-479d-a6be-a38ef6df4d68 with Priority: HIGHEST for action port [ 582.563670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.563810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.564978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.565393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.565481] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.567549] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.567549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.567549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.567549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.567766] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.567766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.567842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.569132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.569132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.569132] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.571572] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-914559d0-7006-479d-a6be-a38ef6df4d68 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.571572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.571572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.571700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.571700] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914559d0-7006-479d-a6be-a38ef6df4d68',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.074403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.077777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.083262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 914559d0-7006-479d-a6be-a38ef6df4d68 with status ACTIVE [ 583.083454] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.083560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.083560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.083884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.083884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.085878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.085878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.085878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.085878] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 914559d0-7006-479d-a6be-a38ef6df4d68 is going to be updated. [ 583.087227] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.107816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.107816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.107816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.107816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.107816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.108079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914559d0-7006-479d-a6be-a38ef6df4d68" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.588759] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.864332] env[66131]: INFO networking_nsxv3.common.synchronization [None req-c7193655-dcf3-41e9-85e6-43b5392e0a87 None None] Enqueued Resource ID: 00193711-e928-4a2e-a0a4-afaf4f21e002 with Priority: HIGHEST for action port [ 583.864332] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00193711-e928-4a2e-a0a4-afaf4f21e002 with Priority: HIGHEST for action port [ 583.864332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-00193711-e928-4a2e-a0a4-afaf4f21e002 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.864332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00193711-e928-4a2e-a0a4-afaf4f21e002" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.864332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00193711-e928-4a2e-a0a4-afaf4f21e002" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.864332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00193711-e928-4a2e-a0a4-afaf4f21e002" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.864332] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00193711-e928-4a2e-a0a4-afaf4f21e002',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.091607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.091912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.091912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.092079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.092156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.092326] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be created. [ 584.121624] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.121743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.122524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.122524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.122524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.136688] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: UNINITIALIZED for 2s [ 584.370506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00193711-e928-4a2e-a0a4-afaf4f21e002 [ 584.370597] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.370695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.370847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.371079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.371201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.371316] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00193711-e928-4a2e-a0a4-afaf4f21e002 already deleted. [ 584.371423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00193711-e928-4a2e-a0a4-afaf4f21e002" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.912193] env[66131]: INFO networking_nsxv3.common.synchronization [None req-1a32a47e-a069-4817-ad51-954a3efb1672 None None] Enqueued Resource ID: ae091c73-4a7f-44c3-90f7-35a618c59311 with Priority: HIGHEST for action port [ 584.912961] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae091c73-4a7f-44c3-90f7-35a618c59311 with Priority: HIGHEST for action port [ 584.913621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae091c73-4a7f-44c3-90f7-35a618c59311 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.913752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae091c73-4a7f-44c3-90f7-35a618c59311" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.913899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae091c73-4a7f-44c3-90f7-35a618c59311" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.914074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae091c73-4a7f-44c3-90f7-35a618c59311" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.914160] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae091c73-4a7f-44c3-90f7-35a618c59311',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.280022] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6e0df485-7e75-401d-8de1-77f7183c685a None None] Enqueued Resource ID: 313dbb9a-827e-4c3a-8648-aec0b8dbddfe with Priority: HIGHEST for action port [ 585.280022] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 313dbb9a-827e-4c3a-8648-aec0b8dbddfe with Priority: HIGHEST for action port [ 585.280022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-313dbb9a-827e-4c3a-8648-aec0b8dbddfe taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.280022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-313dbb9a-827e-4c3a-8648-aec0b8dbddfe" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.280380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-313dbb9a-827e-4c3a-8648-aec0b8dbddfe" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.280835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-313dbb9a-827e-4c3a-8648-aec0b8dbddfe" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.281040] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('313dbb9a-827e-4c3a-8648-aec0b8dbddfe',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.417611] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae091c73-4a7f-44c3-90f7-35a618c59311 [ 585.417847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.417987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.418073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.418276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.418371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.418465] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae091c73-4a7f-44c3-90f7-35a618c59311 already deleted. [ 585.418544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae091c73-4a7f-44c3-90f7-35a618c59311" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.499000] env[66131]: INFO networking_nsxv3.common.synchronization [None req-3aa7acf2-b071-427a-bfd0-5648a1552d7e tempest-VolumesAssistedSnapshotsTest-1481734445 tempest-VolumesAssistedSnapshotsTest-1481734445-project-member] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_rules [ 585.499377] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_rules [ 585.501465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.501626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.501908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.501908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.502020] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.671894] env[66131]: INFO networking_nsxv3.common.synchronization [req-ea97aed3-b02e-4af5-837f-84a06ff5f6f5 req-a97ae9c1-73ce-463e-bf41-e92bd1fca8d9 tempest-ServerDiagnosticsNegativeTest-739937943 tempest-ServerDiagnosticsNegativeTest-739937943-project-member] Enqueued Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_members [ 585.673558] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_members [ 585.674361] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.674361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.674361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.674361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.674586] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.674586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.674687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.675209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.675209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.675209] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.677452] env[66131]: INFO networking_nsxv3.common.synchronization [None req-8e03df4c-7524-4229-922f-390a2f744ee5 None None] Enqueued Resource ID: 3e15b0ec-0168-4811-9994-1f2343058a8b with Priority: HIGHEST for action port [ 585.678259] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e15b0ec-0168-4811-9994-1f2343058a8b with Priority: HIGHEST for action port [ 585.678259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e15b0ec-0168-4811-9994-1f2343058a8b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.678404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e15b0ec-0168-4811-9994-1f2343058a8b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.678404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e15b0ec-0168-4811-9994-1f2343058a8b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.678622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e15b0ec-0168-4811-9994-1f2343058a8b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.678703] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e15b0ec-0168-4811-9994-1f2343058a8b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.783194] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 313dbb9a-827e-4c3a-8648-aec0b8dbddfe [ 585.783343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.783714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.783714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.783817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.785347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.785347] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:313dbb9a-827e-4c3a-8648-aec0b8dbddfe already deleted. [ 585.785347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-313dbb9a-827e-4c3a-8648-aec0b8dbddfe" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.848375] env[66131]: INFO networking_nsxv3.common.synchronization [None req-40e5f8b6-848b-4974-8013-8ba604054637 tempest-VolumesAssistedSnapshotsTest-1481734445 tempest-VolumesAssistedSnapshotsTest-1481734445-project-member] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_rules [ 585.849243] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_rules [ 585.849595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.849687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.023357] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.023842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.023842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.023842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.023842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.024188] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 already deleted. [ 586.024188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.024188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.024517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.024517] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.141070] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.141070] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.141070] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.142019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.142019] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.142019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.142206] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.142506] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.142725] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.142985] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.143142] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.143431] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.143598] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.143765] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.143912] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.144064] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.153716] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 586.154090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.154569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.154880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.155132] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.155323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.155435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.155640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.155769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.155900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.156043] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.168232] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.168405] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.168544] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.168765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.169124] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.169291] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.169406] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.169805] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.170093] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4cb16c-188b-41f1-be9e-60bdece6a2d3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.178781] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.178916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.178985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.179197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.179287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.179473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.179570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.179632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.179775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.179850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.179932] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 already deleted. [ 586.180014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.181028] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e15b0ec-0168-4811-9994-1f2343058a8b [ 586.181205] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.181465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.181465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.181761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.181880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.182009] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e15b0ec-0168-4811-9994-1f2343058a8b already deleted. [ 586.182316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e15b0ec-0168-4811-9994-1f2343058a8b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.545348] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.545348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.545492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.545660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.545734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.545789] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 already deleted. [ 586.545856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.661499] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.661653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.661727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664908] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.664908] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664908] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.664908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.664908] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.673207] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.673441] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.673569] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.674705] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.674705] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.674705] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 5c4cb16c-188b-41f1-be9e-60bdece6a2d3 not found, creating... [ 586.674705] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.674705] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.674705] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.674936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.674936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.675203] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.675354] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.675474] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.676605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.676605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.676605] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 5c4cb16c-188b-41f1-be9e-60bdece6a2d3 is going to be created. [ 586.703317] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.703541] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.703810] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.704298] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.704298] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.704523] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.167823] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c5da787-634a-44a5-9a16-ff46306549cf: rpc.has_security_group_logging(os_id): False [ 587.186822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.186960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.186960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.187155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.187252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.187440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.187537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.187598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.187743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.187821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.188022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.188123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.188165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.188340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.188418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.188602] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.188695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.188754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.188889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.188963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.189070] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be created. [ 587.248733] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.248871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.248968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.249164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.249343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.261646] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: IN_PROGRESS for 2s [ 587.393607] env[66131]: INFO networking_nsxv3.common.synchronization [req-ea97aed3-b02e-4af5-837f-84a06ff5f6f5 req-9cc1c03a-f247-447e-9ab4-04a057984554 service nova] Enqueued Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_rules [ 587.393785] env[66131]: INFO networking_nsxv3.common.synchronization [req-ea97aed3-b02e-4af5-837f-84a06ff5f6f5 req-9cc1c03a-f247-447e-9ab4-04a057984554 service nova] Enqueued Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_members [ 587.393919] env[66131]: INFO networking_nsxv3.common.synchronization [req-ea97aed3-b02e-4af5-837f-84a06ff5f6f5 req-9cc1c03a-f247-447e-9ab4-04a057984554 service nova] Enqueued Resource ID: 5c4cb16c-188b-41f1-be9e-60bdece6a2d3 with Priority: HIGHEST for action port [ 587.394445] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_rules [ 587.394577] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_members [ 587.394673] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c4cb16c-188b-41f1-be9e-60bdece6a2d3 with Priority: HIGHEST for action port [ 587.394936] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.396133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.396246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.396493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.396627] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.397572] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.397696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.397767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.397953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.398133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.398474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.398474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.398474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.398566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.398610] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.399403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.399512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.399577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.399722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.399797] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4cb16c-188b-41f1-be9e-60bdece6a2d3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.811783] env[66131]: INFO networking_nsxv3.common.synchronization [None req-cf362111-7f0d-4f17-bf87-1280ff404e47 None None] Enqueued Resource ID: 3518686b-bbed-4968-8a51-75496325aac2 with Priority: HIGHEST for action port [ 587.813466] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3518686b-bbed-4968-8a51-75496325aac2 with Priority: HIGHEST for action port [ 587.813466] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3518686b-bbed-4968-8a51-75496325aac2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.813754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3518686b-bbed-4968-8a51-75496325aac2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.813822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3518686b-bbed-4968-8a51-75496325aac2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.814791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3518686b-bbed-4968-8a51-75496325aac2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.814791] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3518686b-bbed-4968-8a51-75496325aac2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.906037] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.906037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.906037] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.906037] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c4cb16c-188b-41f1-be9e-60bdece6a2d3 with status ACTIVE [ 587.906037] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.906037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.906037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.906590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.906590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.906590] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.906590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.906712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.906766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.906836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.907442] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.907553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.907617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.907767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.907850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.907937] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c4cb16c-188b-41f1-be9e-60bdece6a2d3 is going to be updated. [ 587.934055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.934240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.934280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.934480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.934615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.934774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c4cb16c-188b-41f1-be9e-60bdece6a2d3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.017298] env[66131]: INFO networking_nsxv3.common.synchronization [req-abe5a8e8-4e94-44d9-8421-6efa5982bf4e req-fdfaff3a-03f1-4c2f-b9a3-775e52f4505c tempest-TenantUsagesTestJSON-353583828 tempest-TenantUsagesTestJSON-353583828-project-member] Enqueued Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_members [ 588.021026] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_members [ 588.021026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.021026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.021026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.021026] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.320623] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3518686b-bbed-4968-8a51-75496325aac2 [ 588.320623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.320623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.320623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.320623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.320623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.320623] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3518686b-bbed-4968-8a51-75496325aac2 already deleted. [ 588.320623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3518686b-bbed-4968-8a51-75496325aac2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.412730] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.521843] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.522033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.522100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.522442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.522562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.522807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.522914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.522979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.523660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.523749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.524864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d already deleted. [ 588.525014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.807314] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.807595] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.807929] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.808164] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.809398] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.812178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.812178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.812178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.812178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.812178] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.812178] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.812178] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.812178] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.813710] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.813710] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.813710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.833727] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.833884] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.834018] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.834734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.835664] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-5fd30429-7e5d-44ea-ba13-55e102bc08ff taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.835664] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.835664] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.835917] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.835956] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fd30429-7e5d-44ea-ba13-55e102bc08ff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.915105] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.915265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.915334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.915550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.916438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.916438] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 is going to be created. [ 588.942606] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.942739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.942811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.944038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.944038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.956120] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 in Status: UNINITIALIZED for 2s [ 589.254561] env[66131]: INFO networking_nsxv3.common.synchronization [None req-dfa95065-802b-44bb-9b20-632deca67ba1 None None] Enqueued Resource ID: d39a8c69-c6cb-4e71-8500-8c967fb623ac with Priority: HIGHEST for action port [ 589.255547] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39a8c69-c6cb-4e71-8500-8c967fb623ac with Priority: HIGHEST for action port [ 589.255885] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39a8c69-c6cb-4e71-8500-8c967fb623ac taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.258085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39a8c69-c6cb-4e71-8500-8c967fb623ac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.258085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39a8c69-c6cb-4e71-8500-8c967fb623ac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.258085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39a8c69-c6cb-4e71-8500-8c967fb623ac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.258085] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39a8c69-c6cb-4e71-8500-8c967fb623ac',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.274217] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 589.274475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.342373] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.342373] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 5fd30429-7e5d-44ea-ba13-55e102bc08ff not found, creating... [ 589.342373] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.342373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.342945] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.342945] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.343042] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.344247] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.344247] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.344247] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 5fd30429-7e5d-44ea-ba13-55e102bc08ff is going to be created. [ 589.364812] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.365051] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.365155] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.365427] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.365644] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.366418] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.530238] env[66131]: INFO networking_nsxv3.common.synchronization [None req-683a0e63-33de-4514-b7f1-f725374f07d7 None None] Enqueued Resource ID: c66556d9-6ed2-4e3b-89fd-86690a45a3b7 with Priority: HIGHEST for action port [ 589.530679] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c66556d9-6ed2-4e3b-89fd-86690a45a3b7 with Priority: HIGHEST for action port [ 589.530963] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c66556d9-6ed2-4e3b-89fd-86690a45a3b7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.531395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c66556d9-6ed2-4e3b-89fd-86690a45a3b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.531395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c66556d9-6ed2-4e3b-89fd-86690a45a3b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.531737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c66556d9-6ed2-4e3b-89fd-86690a45a3b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.532476] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c66556d9-6ed2-4e3b-89fd-86690a45a3b7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.760924] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d39a8c69-c6cb-4e71-8500-8c967fb623ac [ 589.761241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.761421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.761558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.761739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.761833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.761956] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d39a8c69-c6cb-4e71-8500-8c967fb623ac already deleted. [ 589.762054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39a8c69-c6cb-4e71-8500-8c967fb623ac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.035101] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c66556d9-6ed2-4e3b-89fd-86690a45a3b7 [ 590.039029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.039029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.039029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.039029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.039029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.039029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c66556d9-6ed2-4e3b-89fd-86690a45a3b7 already deleted. [ 590.039029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c66556d9-6ed2-4e3b-89fd-86690a45a3b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.390422] env[66131]: INFO networking_nsxv3.common.synchronization [req-abe5a8e8-4e94-44d9-8421-6efa5982bf4e req-0c0e6f05-e05a-42f0-9ca2-bf9486f39cb9 service nova] Enqueued Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_rules [ 590.390824] env[66131]: INFO networking_nsxv3.common.synchronization [req-abe5a8e8-4e94-44d9-8421-6efa5982bf4e req-0c0e6f05-e05a-42f0-9ca2-bf9486f39cb9 service nova] Enqueued Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_members [ 590.391020] env[66131]: INFO networking_nsxv3.common.synchronization [req-abe5a8e8-4e94-44d9-8421-6efa5982bf4e req-0c0e6f05-e05a-42f0-9ca2-bf9486f39cb9 service nova] Enqueued Resource ID: 5fd30429-7e5d-44ea-ba13-55e102bc08ff with Priority: HIGHEST for action port [ 590.392274] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_rules [ 590.392274] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_members [ 590.392274] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd30429-7e5d-44ea-ba13-55e102bc08ff with Priority: HIGHEST for action port [ 590.392489] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.392560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.392670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.393129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.393129] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.394205] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.394322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.394392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.394844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.394937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.395064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.395131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.395291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.395376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.395467] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.397200] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fd30429-7e5d-44ea-ba13-55e102bc08ff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.397200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.397625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.397991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.397991] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fd30429-7e5d-44ea-ba13-55e102bc08ff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.900088] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.901156] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.901391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.901481] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fd30429-7e5d-44ea-ba13-55e102bc08ff with status ACTIVE [ 590.901610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.901717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.901783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.902138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.902138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.902246] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.902342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.902403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.902561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.902637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.902810] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.902899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.902958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.904562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.904562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.904562] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fd30429-7e5d-44ea-ba13-55e102bc08ff is going to be updated. [ 590.928040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.928040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.928040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.928040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.928040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.928040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fd30429-7e5d-44ea-ba13-55e102bc08ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.969868] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 in Status: SUCCESS [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.969868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.969868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.969868] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.991837] env[66131]: INFO networking_nsxv3.common.synchronization [req-e43a2074-99f8-4aff-9cc4-dd402fb9d6a2 req-4a93f9d7-f09a-4854-9113-cde5663d613a tempest-ServerExternalEventsTest-538923010 tempest-ServerExternalEventsTest-538923010-project-member] Enqueued Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_members [ 590.992870] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_members [ 590.992870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.993024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.993024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.993245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.993402] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.993734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.993819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.994013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.994089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.994262] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.007946] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f8c39e17-d903-44e0-8156-c97da23aa138 None None] Enqueued Resource ID: 4098c0da-26cd-4eae-bcd5-d140300a5b2e with Priority: HIGHEST for action port [ 591.008037] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4098c0da-26cd-4eae-bcd5-d140300a5b2e with Priority: HIGHEST for action port [ 591.008668] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4098c0da-26cd-4eae-bcd5-d140300a5b2e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.008776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4098c0da-26cd-4eae-bcd5-d140300a5b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.008836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4098c0da-26cd-4eae-bcd5-d140300a5b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.009104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4098c0da-26cd-4eae-bcd5-d140300a5b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.009193] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4098c0da-26cd-4eae-bcd5-d140300a5b2e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.407477] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.472225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.472604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.472807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.473158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.473589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.473819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.473819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.473945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.474068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.474202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.474381] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.474544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.474600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.474789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.474946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.475097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.475192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.475390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.475498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.475598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.475701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.498935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.498935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.498935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.499222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.499403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.499550] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.499724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.499808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.500037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.500170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.500351] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af already deleted. [ 591.500468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.511316] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4098c0da-26cd-4eae-bcd5-d140300a5b2e [ 591.511588] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.511770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.511897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.511980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.512156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.512228] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4098c0da-26cd-4eae-bcd5-d140300a5b2e already deleted. [ 591.512271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4098c0da-26cd-4eae-bcd5-d140300a5b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.607621] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.607621] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.607843] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.607981] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.608246] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.608397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.608506] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.608712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.608848] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.609056] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.609174] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.609256] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.609355] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.609473] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.609568] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.609690] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.635318] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.635474] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.635607] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.635785] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.636103] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-cefdb1c3-c95c-4cb3-928a-9b9466928a83 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.636272] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.636387] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.636704] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.636836] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cefdb1c3-c95c-4cb3-928a-9b9466928a83',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.911553] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.911714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.911785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.911992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.912103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.912204] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d is going to be created. [ 591.937343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.937518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.937518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.937725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.937886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.947145] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d in Status: UNINITIALIZED for 2s [ 591.978597] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3affe7d0-eaa2-49d5-be04-f70f6d573297: rpc.has_security_group_logging(os_id): False [ 591.998365] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.998513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.998588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.998794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.998884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.999096] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.999190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.999247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.999397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.999476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.999666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.999763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.999821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.999960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.000045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.000230] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.000341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.000410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.000540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.000616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.000704] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 is going to be created. [ 592.056529] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.056713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.056750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.057307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.057307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.069610] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 in Status: IN_PROGRESS for 2s [ 592.139194] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.139408] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.139528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.139812] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.139956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.140142] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port cefdb1c3-c95c-4cb3-928a-9b9466928a83 not found, creating... [ 592.140506] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.140669] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.140761] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.141035] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.141142] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.141444] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.141596] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.141709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.141913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.142059] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.142197] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: cefdb1c3-c95c-4cb3-928a-9b9466928a83 is going to be created. [ 592.167752] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.167945] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.168071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.168426] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.168642] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.168860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.969172] env[66131]: INFO networking_nsxv3.common.synchronization [req-e43a2074-99f8-4aff-9cc4-dd402fb9d6a2 req-3afcc1b1-e8c7-41f0-bc5c-7645437e2858 service nova] Enqueued Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_rules [ 592.969172] env[66131]: INFO networking_nsxv3.common.synchronization [req-e43a2074-99f8-4aff-9cc4-dd402fb9d6a2 req-3afcc1b1-e8c7-41f0-bc5c-7645437e2858 service nova] Enqueued Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_members [ 592.969172] env[66131]: INFO networking_nsxv3.common.synchronization [req-e43a2074-99f8-4aff-9cc4-dd402fb9d6a2 req-3afcc1b1-e8c7-41f0-bc5c-7645437e2858 service nova] Enqueued Resource ID: cefdb1c3-c95c-4cb3-928a-9b9466928a83 with Priority: HIGHEST for action port [ 592.969172] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_rules [ 592.969172] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_members [ 592.969172] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefdb1c3-c95c-4cb3-928a-9b9466928a83 with Priority: HIGHEST for action port [ 592.969599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.969711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.969753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.970130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.970233] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.971092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.971239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.971324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.971495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.971643] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.971733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.971792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.971975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.972085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.972199] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.974577] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-cefdb1c3-c95c-4cb3-928a-9b9466928a83 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.974981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.974981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.975100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.975137] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cefdb1c3-c95c-4cb3-928a-9b9466928a83',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.035474] env[66131]: INFO networking_nsxv3.common.synchronization [req-2e3fc199-f559-40dc-9473-a9a3231b14a1 req-a22a73ad-1479-4a75-b960-90639db6e4be tempest-ServersTestManualDisk-878576868 tempest-ServersTestManualDisk-878576868-project-member] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_members [ 593.036767] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_members [ 593.037188] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.037285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.037352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.037610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.037901] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.037973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.038048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.038617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.038617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.038617] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.119528] env[66131]: INFO networking_nsxv3.common.synchronization [None req-81ae1b29-7715-4e6d-9bf3-a7e25e8b4945 None None] Enqueued Resource ID: 80d54cb7-ab94-4c66-8b6d-f7bc56145357 with Priority: HIGHEST for action port [ 593.119773] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80d54cb7-ab94-4c66-8b6d-f7bc56145357 with Priority: HIGHEST for action port [ 593.120337] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-80d54cb7-ab94-4c66-8b6d-f7bc56145357 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.120456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80d54cb7-ab94-4c66-8b6d-f7bc56145357" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.120520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80d54cb7-ab94-4c66-8b6d-f7bc56145357" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.120797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80d54cb7-ab94-4c66-8b6d-f7bc56145357" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.120888] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80d54cb7-ab94-4c66-8b6d-f7bc56145357',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.285682] env[66131]: INFO networking_nsxv3.common.synchronization [None req-fe26a679-c557-40ad-9a17-6fdbc36e4521 None None] Enqueued Resource ID: e5ef8212-38f4-48d1-8401-3345e6d7446e with Priority: HIGHEST for action port [ 593.286094] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ef8212-38f4-48d1-8401-3345e6d7446e with Priority: HIGHEST for action port [ 593.286377] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5ef8212-38f4-48d1-8401-3345e6d7446e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.286499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5ef8212-38f4-48d1-8401-3345e6d7446e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.286589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5ef8212-38f4-48d1-8401-3345e6d7446e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.286815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5ef8212-38f4-48d1-8401-3345e6d7446e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.287076] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5ef8212-38f4-48d1-8401-3345e6d7446e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.477158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.477349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.477542] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.478571] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cefdb1c3-c95c-4cb3-928a-9b9466928a83 with status ACTIVE [ 593.478760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.478878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.478969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.479171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.479265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.479444] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.479565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.479601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.479941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.479941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.480100] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.480100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.480185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.480449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.480547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.480619] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cefdb1c3-c95c-4cb3-928a-9b9466928a83 is going to be updated. [ 593.502760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.502909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.502970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.503203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.503375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.503561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cefdb1c3-c95c-4cb3-928a-9b9466928a83" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.540543] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.540668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.540723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.540929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.541079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.541290] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.541416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.541485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.541937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.541937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.541937] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 already deleted. [ 593.541937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.624200] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80d54cb7-ab94-4c66-8b6d-f7bc56145357 [ 593.624200] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.624200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.624200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.624200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.624474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.624474] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80d54cb7-ab94-4c66-8b6d-f7bc56145357 already deleted. [ 593.624474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80d54cb7-ab94-4c66-8b6d-f7bc56145357" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.789574] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5ef8212-38f4-48d1-8401-3345e6d7446e [ 593.790818] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.790818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.791639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.791639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.791639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.791639] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5ef8212-38f4-48d1-8401-3345e6d7446e already deleted. [ 593.791639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5ef8212-38f4-48d1-8401-3345e6d7446e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.962197] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d in Status: SUCCESS [ 593.962684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.962979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.963322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.963644] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.963889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.964066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.964351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.964545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.964856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.965058] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.983478] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.084613] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 in Status: SUCCESS [ 594.084843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.467882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.468027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.468027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.468246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.468969] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.469302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.469302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.469462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.469531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.469621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.469778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.469876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.469940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.470104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.470242] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.470517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.470517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.470609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.470609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.470686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.470778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.486840] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.487281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.487281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.487281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.487430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.487430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af is going to be created. [ 594.490909] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.491089] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-762" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.491212] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-762" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.491479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-762" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.491726] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.491941] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.492025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.492245] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.492395] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.492588] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.492695] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.492797] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.492929] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.492998] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.493109] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.493229] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.515990] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.515990] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.515990] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.515990] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-762" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.515990] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.515990] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.515990] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.515990] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.515990] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.517538] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.517821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.518207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.518514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.519221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.529639] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af in Status: UNINITIALIZED for 2s [ 594.973122] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d: rpc.has_security_group_logging(os_id): False [ 594.992249] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.992693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.992693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.992693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.992839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.993032] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.993175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.993175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.993286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.993522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.993522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.993757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.993757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.993911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.993911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.994094] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.994184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.994235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.994379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.994713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.995942] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d is going to be created. [ 595.017613] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.017842] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.017953] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.018254] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.018402] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.018745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a not found, creating... [ 595.019184] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.019283] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.019335] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.019521] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.019648] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.019929] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.020089] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.020199] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.020458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.020587] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.020720] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a is going to be created. [ 595.041041] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.041041] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.041041] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.041579] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.041810] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.041913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.060735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.060918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.061161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.061248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.061544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.073666] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d in Status: IN_PROGRESS for 2s [ 595.233632] env[66131]: INFO networking_nsxv3.common.synchronization [None req-df849e85-62b2-41b3-bde4-7778df6b45c2 None None] Enqueued Resource ID: c48d02df-0a54-4c69-a5d0-bf855386a3f7 with Priority: HIGHEST for action port [ 595.233632] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c48d02df-0a54-4c69-a5d0-bf855386a3f7 with Priority: HIGHEST for action port [ 595.234049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c48d02df-0a54-4c69-a5d0-bf855386a3f7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.234353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c48d02df-0a54-4c69-a5d0-bf855386a3f7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.235062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c48d02df-0a54-4c69-a5d0-bf855386a3f7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.235062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c48d02df-0a54-4c69-a5d0-bf855386a3f7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.235062] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c48d02df-0a54-4c69-a5d0-bf855386a3f7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.416457] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e9f7e38d-2283-4913-a5b5-8fb3c4612c77 None None] Enqueued Resource ID: 79678094-a6a6-4581-bbdb-3ea21b328aa1 with Priority: HIGHEST for action port [ 595.417789] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79678094-a6a6-4581-bbdb-3ea21b328aa1 with Priority: HIGHEST for action port [ 595.417789] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-79678094-a6a6-4581-bbdb-3ea21b328aa1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.418684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79678094-a6a6-4581-bbdb-3ea21b328aa1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.418684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79678094-a6a6-4581-bbdb-3ea21b328aa1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.418684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79678094-a6a6-4581-bbdb-3ea21b328aa1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.418684] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79678094-a6a6-4581-bbdb-3ea21b328aa1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.740546] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c48d02df-0a54-4c69-a5d0-bf855386a3f7 [ 595.740801] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.740936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.741017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.741255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.741386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.741496] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c48d02df-0a54-4c69-a5d0-bf855386a3f7 already deleted. [ 595.741600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c48d02df-0a54-4c69-a5d0-bf855386a3f7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.789070] env[66131]: INFO networking_nsxv3.common.synchronization [req-2e3fc199-f559-40dc-9473-a9a3231b14a1 req-77eb7c08-8a20-4dfd-ad0f-3b83c7bfbca0 service nova] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_rules [ 595.789477] env[66131]: INFO networking_nsxv3.common.synchronization [req-2e3fc199-f559-40dc-9473-a9a3231b14a1 req-77eb7c08-8a20-4dfd-ad0f-3b83c7bfbca0 service nova] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_members [ 595.789741] env[66131]: INFO networking_nsxv3.common.synchronization [req-2e3fc199-f559-40dc-9473-a9a3231b14a1 req-77eb7c08-8a20-4dfd-ad0f-3b83c7bfbca0 service nova] Enqueued Resource ID: 5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a with Priority: HIGHEST for action port [ 595.790567] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_rules [ 595.790949] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_members [ 595.791197] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a with Priority: HIGHEST for action port [ 595.791594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.792526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.792526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.792526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.792526] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.793315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.793315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.793689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.793689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.793789] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.793865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.793913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.794721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.794826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.794952] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.796398] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.796535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.796627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.796988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.796988] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.921423] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79678094-a6a6-4581-bbdb-3ea21b328aa1 [ 595.921822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.921995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.922105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.922352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.922497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.922531] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79678094-a6a6-4581-bbdb-3ea21b328aa1 already deleted. [ 595.922913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79678094-a6a6-4581-bbdb-3ea21b328aa1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.298583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.300093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.301059] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.301815] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a with status ACTIVE [ 596.302054] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.302175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.302239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.302441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.302529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.302696] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.303128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.303220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.303385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.303491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.303657] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.303830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.303914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.304083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.304155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.304239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a is going to be updated. [ 596.326083] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.326381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.326381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.327177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.327177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.327177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bf0e1bb-89b2-4a36-9941-ad6ca6c8dc3a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.533847] env[66131]: INFO networking_nsxv3.common.synchronization [req-86f356d3-f88f-4620-9206-7308b51c828e req-80198a25-4848-4eb7-bd27-cd6b64ef38c1 tempest-MigrationsAdminTest-1398354370 tempest-MigrationsAdminTest-1398354370-project-member] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 596.535052] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 596.535691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.535900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.536056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.536401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.536708] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.536901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.537019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.537257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.537408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.537866] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.542054] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af in Status: SUCCESS [ 596.542342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.542567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.542916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.543206] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.543348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.543451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.543656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.543758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.543872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.543988] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.771389] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e89be46d-2383-4919-aa8d-0c2ef23c48b1 None None] Enqueued Resource ID: f6567116-b2cd-4390-8d02-f38484c608a1 with Priority: HIGHEST for action port [ 596.772417] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6567116-b2cd-4390-8d02-f38484c608a1 with Priority: HIGHEST for action port [ 596.774284] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6567116-b2cd-4390-8d02-f38484c608a1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.774462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6567116-b2cd-4390-8d02-f38484c608a1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.774462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6567116-b2cd-4390-8d02-f38484c608a1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.774714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6567116-b2cd-4390-8d02-f38484c608a1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.774801] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6567116-b2cd-4390-8d02-f38484c608a1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.807208] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.040515] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.040583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.041128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.041128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.041128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.041437] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.041437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.041437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.041741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.041795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.041925] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 already deleted. [ 597.041966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.046401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.046527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.046577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.046735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.046878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.046972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.047048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.047198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.047266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.047376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.047493] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.047587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.047643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.048291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.048291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.048291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.048291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.048291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.048291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.048582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.048582] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.087364] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d in Status: SUCCESS [ 597.087364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.213064] env[66131]: INFO networking_nsxv3.common.synchronization [None req-abe5d84b-1750-4471-af5a-121244187470 None None] Enqueued Resource ID: 73d89f11-4883-494a-a8b2-b72b59b2aceb with Priority: HIGHEST for action port [ 597.213351] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73d89f11-4883-494a-a8b2-b72b59b2aceb with Priority: HIGHEST for action port [ 597.213923] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-73d89f11-4883-494a-a8b2-b72b59b2aceb taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.214060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73d89f11-4883-494a-a8b2-b72b59b2aceb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.214128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73d89f11-4883-494a-a8b2-b72b59b2aceb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.214387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73d89f11-4883-494a-a8b2-b72b59b2aceb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.214508] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73d89f11-4883-494a-a8b2-b72b59b2aceb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.277865] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6567116-b2cd-4390-8d02-f38484c608a1 [ 597.278119] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.278236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.278327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.278554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.278649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.278839] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6567116-b2cd-4390-8d02-f38484c608a1 already deleted. [ 597.278839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6567116-b2cd-4390-8d02-f38484c608a1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.309716] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.310089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.310089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.310315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.310315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.310534] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 is going to be created. [ 597.361505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.361659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.361747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.361934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.362134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.377221] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 in Status: UNINITIALIZED for 2s [ 597.550856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 019f05d6-48e0-4ee7-bcb4-af4a1a2925af: rpc.has_security_group_logging(os_id): False [ 597.571894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.572119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.572119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.572327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.572566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.573066] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.573066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.573066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.573066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.573858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.573991] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.578082] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.578082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.578082] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af is going to be created. [ 597.642233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.642233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.642233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.642773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.646247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.669088] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af in Status: IN_PROGRESS for 2s [ 597.718610] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73d89f11-4883-494a-a8b2-b72b59b2aceb [ 597.719068] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.719068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.719284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.719487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.719487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.719605] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73d89f11-4883-494a-a8b2-b72b59b2aceb already deleted. [ 597.719862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73d89f11-4883-494a-a8b2-b72b59b2aceb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.846321] env[66131]: INFO networking_nsxv3.common.synchronization [req-46f4fa32-8709-4400-aa6c-0cdfdee70004 req-7a9cda83-6593-46f5-8875-927bc63b0203 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 597.847211] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 597.847322] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.847566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.847737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.848031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.849206] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.849206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.849206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.849206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.849206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.849206] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.889563] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.889754] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.889871] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.890140] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.890425] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.890575] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.890955] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.891165] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.891352] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.891545] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.891659] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.891763] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.891864] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.891965] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.892081] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.892207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.912435] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.912599] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.912676] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.912902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.913243] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.913413] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.914030] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.914030] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.914030] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b1f421-6a67-4626-8cf6-a4569b1a9aaf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.249719] env[66131]: INFO networking_nsxv3.common.synchronization [None req-911dc40c-b30b-4a73-bd9d-837666033c38 None None] Enqueued Resource ID: 50de35c3-6f00-4cae-9bc0-6abd848d182c with Priority: HIGHEST for action port [ 598.251021] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50de35c3-6f00-4cae-9bc0-6abd848d182c with Priority: HIGHEST for action port [ 598.251021] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-50de35c3-6f00-4cae-9bc0-6abd848d182c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.251021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50de35c3-6f00-4cae-9bc0-6abd848d182c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.251261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50de35c3-6f00-4cae-9bc0-6abd848d182c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.251350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50de35c3-6f00-4cae-9bc0-6abd848d182c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.251488] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50de35c3-6f00-4cae-9bc0-6abd848d182c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.351040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.351497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.351592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.351761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.351854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.352087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.352200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.352321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.352401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.352477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.352562] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a already deleted. [ 598.352658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.418948] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.418948] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 40b1f421-6a67-4626-8cf6-a4569b1a9aaf not found, creating... [ 598.418948] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.418948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.419465] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.419465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.419465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.419465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.419465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.419465] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 40b1f421-6a67-4626-8cf6-a4569b1a9aaf is going to be created. [ 598.440424] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.440635] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.440754] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.441037] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.441337] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.441553] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.755062] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50de35c3-6f00-4cae-9bc0-6abd848d182c [ 598.755062] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.755062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.755062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.755062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.755062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.755062] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50de35c3-6f00-4cae-9bc0-6abd848d182c already deleted. [ 598.755062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50de35c3-6f00-4cae-9bc0-6abd848d182c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.081597] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5bb71698-2c1e-433d-bd0c-686a205ea7bc None None] Enqueued Resource ID: a794c2e5-65c1-49e0-b49d-a47abd2f19e6 with Priority: HIGHEST for action port [ 599.081597] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a794c2e5-65c1-49e0-b49d-a47abd2f19e6 with Priority: HIGHEST for action port [ 599.081902] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a794c2e5-65c1-49e0-b49d-a47abd2f19e6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.083365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a794c2e5-65c1-49e0-b49d-a47abd2f19e6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.083590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a794c2e5-65c1-49e0-b49d-a47abd2f19e6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.083919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a794c2e5-65c1-49e0-b49d-a47abd2f19e6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.084030] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a794c2e5-65c1-49e0-b49d-a47abd2f19e6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.177503] env[66131]: INFO networking_nsxv3.common.synchronization [req-86f356d3-f88f-4620-9206-7308b51c828e req-4b88d357-5fd3-4d2e-bab9-73198fa337c1 service nova] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_rules [ 599.177738] env[66131]: INFO networking_nsxv3.common.synchronization [req-86f356d3-f88f-4620-9206-7308b51c828e req-4b88d357-5fd3-4d2e-bab9-73198fa337c1 service nova] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 599.178062] env[66131]: INFO networking_nsxv3.common.synchronization [req-86f356d3-f88f-4620-9206-7308b51c828e req-4b88d357-5fd3-4d2e-bab9-73198fa337c1 service nova] Enqueued Resource ID: 40b1f421-6a67-4626-8cf6-a4569b1a9aaf with Priority: HIGHEST for action port [ 599.178600] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_rules [ 599.178866] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 599.178957] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b1f421-6a67-4626-8cf6-a4569b1a9aaf with Priority: HIGHEST for action port [ 599.179660] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.179660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.179660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.179877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.179976] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.181103] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.181267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.181553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.181667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.181874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.181968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.182033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.185953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.186074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.186196] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.187106] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.187233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.187298] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.187453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.187528] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b1f421-6a67-4626-8cf6-a4569b1a9aaf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.387705] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 in Status: SUCCESS [ 599.388094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.388145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.388435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.388640] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.388765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.388834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.389011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.389104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.389194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.389288] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.589542] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a794c2e5-65c1-49e0-b49d-a47abd2f19e6 [ 599.589651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.589771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.589843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.590073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.590265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.590265] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a794c2e5-65c1-49e0-b49d-a47abd2f19e6 already deleted. [ 599.590367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a794c2e5-65c1-49e0-b49d-a47abd2f19e6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.686041] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af in Status: SUCCESS [ 599.686041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.691434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.691563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.691872] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.692621] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40b1f421-6a67-4626-8cf6-a4569b1a9aaf with status ACTIVE [ 599.692935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.693080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.693080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.695304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.697097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.697097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.697097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.697097] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40b1f421-6a67-4626-8cf6-a4569b1a9aaf is going to be updated. [ 599.719269] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.719554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.719554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.719756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.719798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.719974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40b1f421-6a67-4626-8cf6-a4569b1a9aaf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.787027] env[66131]: INFO networking_nsxv3.common.synchronization [None req-fc43ca59-c0e8-4ed7-b927-42c899c46ce2 None None] Enqueued Resource ID: 77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec with Priority: HIGHEST for action port [ 599.787027] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec with Priority: HIGHEST for action port [ 599.787027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.787027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.787027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.787027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.787027] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.793797] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.795310] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.795310] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.795310] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.795310] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.795310] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.795726] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.796058] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.796299] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.796640] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.796857] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.797052] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.797323] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.799447] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.799447] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.799447] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.820196] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.820436] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.820581] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.820774] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.821147] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-54448266-96b6-4a8c-9e58-6c940a752a21 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.821374] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.821479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.821870] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.822049] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54448266-96b6-4a8c-9e58-6c940a752a21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.893113] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.077297] env[66131]: INFO networking_nsxv3.common.synchronization [None req-d5fca891-7447-46e6-8976-7ecaaffe040b None None] Enqueued Resource ID: d1fe9deb-66e8-4162-ba61-5de887c7d2be with Priority: HIGHEST for action port [ 600.077899] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1fe9deb-66e8-4162-ba61-5de887c7d2be with Priority: HIGHEST for action port [ 600.078299] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1fe9deb-66e8-4162-ba61-5de887c7d2be taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.078377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1fe9deb-66e8-4162-ba61-5de887c7d2be" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.078461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1fe9deb-66e8-4162-ba61-5de887c7d2be" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.078686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1fe9deb-66e8-4162-ba61-5de887c7d2be" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.078779] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1fe9deb-66e8-4162-ba61-5de887c7d2be',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.199068] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.293585] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec [ 600.293585] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.293585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.293585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.293585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.293585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.293585] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec already deleted. [ 600.293585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e2cad6-f3fc-4c1c-bd1f-ca189f4fb6ec" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.328250] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.328250] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 54448266-96b6-4a8c-9e58-6c940a752a21 not found, creating... [ 600.328250] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.328250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.328873] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.329187] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.329368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.329520] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.329761] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.330993] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.331225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 54448266-96b6-4a8c-9e58-6c940a752a21 is going to be created. [ 600.352444] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.354528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.354528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.354528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.354528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.354528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.396021] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a60c2e7-c063-4bbc-be63-e2c41ed90972: rpc.has_security_group_logging(os_id): False [ 600.416091] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.416235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.416235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.417047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.417047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.417047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.417047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.417047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.417323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.417323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.417323] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 is going to be created. [ 600.511596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.511785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.511785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.511993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.512370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.529573] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 in Status: IN_PROGRESS for 2s [ 600.584232] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1fe9deb-66e8-4162-ba61-5de887c7d2be [ 600.584609] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.584609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.584609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.584799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.585682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.585682] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1fe9deb-66e8-4162-ba61-5de887c7d2be already deleted. [ 600.585682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1fe9deb-66e8-4162-ba61-5de887c7d2be" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.702595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.702595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.702595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.702595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.702595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.702595] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be created. [ 600.741584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.741780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.741824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.742065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.742245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.755060] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: UNINITIALIZED for 2s [ 601.075519] env[66131]: INFO networking_nsxv3.common.synchronization [req-46f4fa32-8709-4400-aa6c-0cdfdee70004 req-01d85b34-f408-4b0a-b0f5-aa890efe3ea9 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 601.075691] env[66131]: INFO networking_nsxv3.common.synchronization [req-46f4fa32-8709-4400-aa6c-0cdfdee70004 req-01d85b34-f408-4b0a-b0f5-aa890efe3ea9 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 601.075820] env[66131]: INFO networking_nsxv3.common.synchronization [req-46f4fa32-8709-4400-aa6c-0cdfdee70004 req-01d85b34-f408-4b0a-b0f5-aa890efe3ea9 service nova] Enqueued Resource ID: 54448266-96b6-4a8c-9e58-6c940a752a21 with Priority: HIGHEST for action port [ 601.076062] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 601.076194] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 601.076286] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54448266-96b6-4a8c-9e58-6c940a752a21 with Priority: HIGHEST for action port [ 601.076859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.077058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.077058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.077385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.077385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.080778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.080778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.080778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.080778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-54448266-96b6-4a8c-9e58-6c940a752a21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.080778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.080778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54448266-96b6-4a8c-9e58-6c940a752a21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.204137] env[66131]: INFO networking_nsxv3.common.synchronization [None req-c0e31579-f45e-4609-bf2e-eb81b6f62fdc None None] Enqueued Resource ID: dfec55e9-db14-43e0-8c69-3d9c2cc44fc1 with Priority: HIGHEST for action port [ 601.204137] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfec55e9-db14-43e0-8c69-3d9c2cc44fc1 with Priority: HIGHEST for action port [ 601.204137] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfec55e9-db14-43e0-8c69-3d9c2cc44fc1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.204734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfec55e9-db14-43e0-8c69-3d9c2cc44fc1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.204981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfec55e9-db14-43e0-8c69-3d9c2cc44fc1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.205415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfec55e9-db14-43e0-8c69-3d9c2cc44fc1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.205878] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfec55e9-db14-43e0-8c69-3d9c2cc44fc1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.457391] env[66131]: INFO networking_nsxv3.common.synchronization [req-259dd63a-929d-4870-9568-e72e4e58a67b req-b5fbf525-a2e9-4227-b133-a38a3ccb96fb tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 601.457391] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 601.457692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.459200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.459354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.460761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.460761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.460761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.460761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.460761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.460761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.460761] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.584434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.584434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.584434] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.586430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54448266-96b6-4a8c-9e58-6c940a752a21 with status ACTIVE [ 601.586430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.586547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.586547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.586750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.587027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.588245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.588443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.588497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.589490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.589490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.589490] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.589490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.589490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.589706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.589706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.589706] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54448266-96b6-4a8c-9e58-6c940a752a21 is going to be updated. [ 601.619788] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.619788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.619788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.619788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.619788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.619788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54448266-96b6-4a8c-9e58-6c940a752a21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.709929] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfec55e9-db14-43e0-8c69-3d9c2cc44fc1 [ 601.710208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.710347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.710437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.710672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.710772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.710874] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfec55e9-db14-43e0-8c69-3d9c2cc44fc1 already deleted. [ 601.710955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfec55e9-db14-43e0-8c69-3d9c2cc44fc1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.881031] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.881031] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-781" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.881031] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-781" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.881031] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-781" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.881575] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.883465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.883465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.883465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.883465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.883465] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.883465] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.883465] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.883817] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.883817] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.884049] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.884194] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.911924] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.912228] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.912407] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.912669] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-781" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.913274] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-60bc7960-c968-4bed-ad23-59c07182722f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.913589] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.913734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.914188] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.914410] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60bc7960-c968-4bed-ad23-59c07182722f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.967266] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.967477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.967553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.967786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.967896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.968133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.968252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.968323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.968575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.968659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.968831] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 already deleted. [ 601.968898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.094102] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.279586] env[66131]: INFO networking_nsxv3.common.synchronization [None req-8ce7f24b-1dee-47ee-9f89-7064b279c696 None None] Enqueued Resource ID: b40a8dc2-658a-4814-81be-7a083535e5e0 with Priority: HIGHEST for action port [ 602.280334] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40a8dc2-658a-4814-81be-7a083535e5e0 with Priority: HIGHEST for action port [ 602.280934] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40a8dc2-658a-4814-81be-7a083535e5e0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.281298] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40a8dc2-658a-4814-81be-7a083535e5e0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.281412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40a8dc2-658a-4814-81be-7a083535e5e0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.281695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40a8dc2-658a-4814-81be-7a083535e5e0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.281790] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40a8dc2-658a-4814-81be-7a083535e5e0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.418463] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.418463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.418463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.418463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.418463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.418924] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 60bc7960-c968-4bed-ad23-59c07182722f not found, creating... [ 602.418924] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.419140] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.419140] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.419765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.419765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.419975] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.420153] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.420358] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.420746] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.420898] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.421055] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 60bc7960-c968-4bed-ad23-59c07182722f is going to be created. [ 602.442637] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.442987] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.443236] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.444514] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.444514] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.444514] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.542455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 in Status: SUCCESS [ 602.542825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.595663] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.595855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.595918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.596193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.596290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.596400] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be created. [ 602.627158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.627358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.627436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.627632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.627797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.639791] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: UNINITIALIZED for 2s [ 602.765477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 602.765702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.765893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.766253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.767059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.767059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.767059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.767059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.767059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.767338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.767338] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.783949] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b40a8dc2-658a-4814-81be-7a083535e5e0 [ 602.784254] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.784373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.784415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.784654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.784746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.784855] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b40a8dc2-658a-4814-81be-7a083535e5e0 already deleted. [ 602.785061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40a8dc2-658a-4814-81be-7a083535e5e0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.184052] env[66131]: INFO networking_nsxv3.common.synchronization [req-259dd63a-929d-4870-9568-e72e4e58a67b req-ea3735d6-9d7f-4fd6-8c48-d7be24625e7f service nova] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 603.184304] env[66131]: INFO networking_nsxv3.common.synchronization [req-259dd63a-929d-4870-9568-e72e4e58a67b req-ea3735d6-9d7f-4fd6-8c48-d7be24625e7f service nova] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 603.184367] env[66131]: INFO networking_nsxv3.common.synchronization [req-259dd63a-929d-4870-9568-e72e4e58a67b req-ea3735d6-9d7f-4fd6-8c48-d7be24625e7f service nova] Enqueued Resource ID: 60bc7960-c968-4bed-ad23-59c07182722f with Priority: HIGHEST for action port [ 603.184906] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 603.188022] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 603.188022] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60bc7960-c968-4bed-ad23-59c07182722f with Priority: HIGHEST for action port [ 603.188022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.188022] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.188022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.188022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.188022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.188022] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.189924] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-60bc7960-c968-4bed-ad23-59c07182722f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.189924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.189924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.192970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.192970] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60bc7960-c968-4bed-ad23-59c07182722f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.269279] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.269450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.269516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.269736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.269911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.270026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.270092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.270241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.270328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.270574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.270826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.270957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.271065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.271259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.271793] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.271793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.271793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.271793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.271989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.271989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.272182] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.690189] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.693294] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.693429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.693565] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60bc7960-c968-4bed-ad23-59c07182722f with status ACTIVE [ 603.693935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.693935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.693935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.694091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.694187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.694354] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.694443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.694502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.694664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.694723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.694894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.695019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.695085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.695360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.695360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.695467] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60bc7960-c968-4bed-ad23-59c07182722f is going to be updated. [ 603.720177] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.720358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.720397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.720679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.720854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.721067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.778362] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd68ac80-456d-40a6-bada-de320b838ff6: rpc.has_security_group_logging(os_id): False [ 603.800240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.800240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.800240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.800877] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.801022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.801098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.801621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.801791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.802078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.802311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.802311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.803207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be created. [ 603.822647] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5d347d6-8efd-4c33-b60f-97e85b416fc1 req-7b79f6ca-661a-4c7c-b73d-bb9d88cce06e tempest-ImagesNegativeTestJSON-1023338767 tempest-ImagesNegativeTestJSON-1023338767-project-member] Enqueued Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_members [ 603.823191] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_members [ 603.823510] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.823633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.823699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.823972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.829279] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.829646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.829646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.830279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.830383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.830814] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.882678] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.882840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.882925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.883147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.883329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.927395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 604.194234] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.297777] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.297979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-856" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.298110] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-856" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.298476] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-856" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.298713] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.298869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.298977] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.299339] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.300230] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.300230] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.300230] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.300230] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.300230] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.300230] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.300230] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.300689] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.330563] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.330697] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.331019] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.331019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-856" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.332386] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-83b4172d-067f-4661-a879-6435336138c1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.332386] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.332386] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.332386] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.332386] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b4172d-067f-4661-a879-6435336138c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.337063] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.337063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.337063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.337303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.337303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.337835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.337835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.337835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.337835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.337835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.338199] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 already deleted. [ 604.338199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.423835] env[66131]: INFO networking_nsxv3.common.synchronization [None req-06a03054-28bb-49ff-ad39-f1340dad3b3e None None] Enqueued Resource ID: f2db86b8-8e87-46d1-94f2-63623d2bef82 with Priority: HIGHEST for action port [ 604.424516] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2db86b8-8e87-46d1-94f2-63623d2bef82 with Priority: HIGHEST for action port [ 604.425333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2db86b8-8e87-46d1-94f2-63623d2bef82 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.425476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2db86b8-8e87-46d1-94f2-63623d2bef82" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.425557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2db86b8-8e87-46d1-94f2-63623d2bef82" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.425901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2db86b8-8e87-46d1-94f2-63623d2bef82" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.425990] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2db86b8-8e87-46d1-94f2-63623d2bef82',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.650832] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 604.651201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.651443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.651927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.651997] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.652170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.652276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.652506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.652655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.652758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.652856] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.696379] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.696718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.696718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.696951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.697095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.697221] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be created. [ 604.726316] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.726539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.726614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.726895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.727099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.738176] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: UNINITIALIZED for 2s [ 604.834518] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.834850] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.835055] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.835443] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.835663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.835901] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 83b4172d-067f-4661-a879-6435336138c1 not found, creating... [ 604.836310] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.836665] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.836930] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.837270] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.837479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.837944] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.838206] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.838411] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.838698] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.838901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.839122] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 83b4172d-067f-4661-a879-6435336138c1 is going to be created. [ 604.862504] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.862746] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.862938] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.863274] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.863625] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.863896] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.928202] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2db86b8-8e87-46d1-94f2-63623d2bef82 [ 604.928528] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.928666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.928713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.928982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.929112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.929188] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2db86b8-8e87-46d1-94f2-63623d2bef82 already deleted. [ 604.929290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2db86b8-8e87-46d1-94f2-63623d2bef82" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.157302] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.157492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.157566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.157816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.158017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.158135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.158214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.158395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.158489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.158582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.158740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.158837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.158898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.159055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.159271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.159347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.159347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.159475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.159555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.159638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.159734] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.601833] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5d347d6-8efd-4c33-b60f-97e85b416fc1 req-fb7ae4b6-a7b1-43ba-a116-370c9f935a36 service nova] Enqueued Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_rules [ 605.601833] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5d347d6-8efd-4c33-b60f-97e85b416fc1 req-fb7ae4b6-a7b1-43ba-a116-370c9f935a36 service nova] Enqueued Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_members [ 605.602424] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5d347d6-8efd-4c33-b60f-97e85b416fc1 req-fb7ae4b6-a7b1-43ba-a116-370c9f935a36 service nova] Enqueued Resource ID: 83b4172d-067f-4661-a879-6435336138c1 with Priority: HIGHEST for action port [ 605.602544] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_rules [ 605.602694] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_members [ 605.602792] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b4172d-067f-4661-a879-6435336138c1 with Priority: HIGHEST for action port [ 605.603077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.603199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.603350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.603670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.603670] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.604799] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.605561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.605561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.605561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.605753] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.605753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.606469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.606469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.606469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.606469] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.607034] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-83b4172d-067f-4661-a879-6435336138c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.607170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.607238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.607336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.607407] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83b4172d-067f-4661-a879-6435336138c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.663701] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6518e255-8a48-4fe6-8c80-b478b31e143a: rpc.has_security_group_logging(os_id): False [ 605.702787] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.706030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.706030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.706030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.707094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.707437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.710932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.710932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.710932] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.710932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.710932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.710932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.710932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.710932] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be created. [ 605.798044] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.798044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.798044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.798044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.798044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.811795] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 605.941172] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 605.941406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.109620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.109816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.109943] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.113297] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83b4172d-067f-4661-a879-6435336138c1 with status ACTIVE [ 606.113297] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.113960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.113960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.113960] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114418] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114756] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83b4172d-067f-4661-a879-6435336138c1 is going to be updated. [ 606.140522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.140688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.140759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.140962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.141114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.141402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83b4172d-067f-4661-a879-6435336138c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.485968] env[66131]: INFO networking_nsxv3.common.synchronization [req-111cf50d-3eab-43f5-8c54-d2d2ccf88f4e req-08e85d32-8773-4de0-aae8-ac4a44cd32d8 tempest-VolumesAssistedSnapshotsTest-1481734445 tempest-VolumesAssistedSnapshotsTest-1481734445-project-member] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_members [ 606.485968] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_members [ 606.486119] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.486252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.486356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.486707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.487344] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.487344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.487344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.487638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.487638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.487774] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.613659] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.769281] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: SUCCESS [ 606.769734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.769802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.770081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.770715] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.770715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.770715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.770912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.770953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.774976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.774976] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.996180] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.996180] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.996180] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 already deleted. [ 606.996180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.020073] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.020292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-868" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.020423] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-868" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.021238] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-868" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.021238] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.021238] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.021426] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.021535] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.021700] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.022326] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.022454] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.022565] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.022672] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.022778] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.023867] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.023867] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.048141] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.048141] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.048141] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.048141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-868" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.048141] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-f0c818e3-7907-4596-af1b-0cdadad51fea taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.048141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.048141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.048141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.048141] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0c818e3-7907-4596-af1b-0cdadad51fea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.118468] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.118651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.118725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.119049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.119218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.119397] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 is going to be created. [ 607.121959] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2477d04d-c8f3-4b44-9098-eba4b6664f23 None None] Enqueued Resource ID: e833f9d5-71c1-477e-99ac-26d9e57b2451 with Priority: HIGHEST for action port [ 607.122559] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e833f9d5-71c1-477e-99ac-26d9e57b2451 with Priority: HIGHEST for action port [ 607.123333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e833f9d5-71c1-477e-99ac-26d9e57b2451 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.123456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e833f9d5-71c1-477e-99ac-26d9e57b2451" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.123544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e833f9d5-71c1-477e-99ac-26d9e57b2451" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.123998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e833f9d5-71c1-477e-99ac-26d9e57b2451" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.123998] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e833f9d5-71c1-477e-99ac-26d9e57b2451',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.164261] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.165196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.165196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.165196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.165196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.174838] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 in Status: UNINITIALIZED for 2s [ 607.279702] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.551826] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.552120] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.552327] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.552507] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.552657] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.552832] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port f0c818e3-7907-4596-af1b-0cdadad51fea not found, creating... [ 607.553114] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.553275] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.553387] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.553598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.553731] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.554017] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.554189] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.554328] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.554536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.554687] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.554839] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: f0c818e3-7907-4596-af1b-0cdadad51fea is going to be created. [ 607.577363] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.577646] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.577774] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.578155] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.578425] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.578712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.628419] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e833f9d5-71c1-477e-99ac-26d9e57b2451 [ 607.628592] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.628854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.628854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.629091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.629177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.629314] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e833f9d5-71c1-477e-99ac-26d9e57b2451 already deleted. [ 607.629375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e833f9d5-71c1-477e-99ac-26d9e57b2451" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.782640] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9ea0bc7-effb-4d5e-938c-ccd65bc31173: rpc.has_security_group_logging(os_id): False [ 607.813589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.813819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.813870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.814148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.814257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.814539] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.814686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.814772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.814969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.815092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.815192] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be created. [ 607.835332] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 607.835561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.891038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.891038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.891038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.891038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.891038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.906016] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: IN_PROGRESS for 2s [ 608.343230] env[66131]: INFO networking_nsxv3.common.synchronization [req-111cf50d-3eab-43f5-8c54-d2d2ccf88f4e req-73c7942f-43f4-4c69-899b-a955853918c7 service nova] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_rules [ 608.343412] env[66131]: INFO networking_nsxv3.common.synchronization [req-111cf50d-3eab-43f5-8c54-d2d2ccf88f4e req-73c7942f-43f4-4c69-899b-a955853918c7 service nova] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_members [ 608.343544] env[66131]: INFO networking_nsxv3.common.synchronization [req-111cf50d-3eab-43f5-8c54-d2d2ccf88f4e req-73c7942f-43f4-4c69-899b-a955853918c7 service nova] Enqueued Resource ID: f0c818e3-7907-4596-af1b-0cdadad51fea with Priority: HIGHEST for action port [ 608.343815] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_rules [ 608.343958] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_members [ 608.344067] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c818e3-7907-4596-af1b-0cdadad51fea with Priority: HIGHEST for action port [ 608.344658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.344799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.345026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.345133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.345246] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.346056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.346172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.346239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.346414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.346561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.346657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.346717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.347599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.347599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.347599] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.348474] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0c818e3-7907-4596-af1b-0cdadad51fea taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.348582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.348724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.348951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.350403] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0c818e3-7907-4596-af1b-0cdadad51fea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.023787] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.024806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.026766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.026766] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0c818e3-7907-4596-af1b-0cdadad51fea with status ACTIVE [ 609.027217] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.027217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.027217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.027217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.027362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.028198] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.028198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.028198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.028740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.028778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.029627] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.029627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.029750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.029905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.029992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.030194] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0c818e3-7907-4596-af1b-0cdadad51fea is going to be updated. [ 609.061551] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.061551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.061551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.061551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.061551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.061551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0c818e3-7907-4596-af1b-0cdadad51fea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.187328] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 in Status: SUCCESS [ 609.188895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.189095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.189332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.189529] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.189650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.189708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.189944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.189944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.190099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.190170] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.534992] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.693236] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.693457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.693707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.693844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.694522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.694522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.694522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.694522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.694819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.694819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.695087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.695087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.695191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.695315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.695550] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.695639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.695697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.695877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.695989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.700836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.701075] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.925878] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: SUCCESS [ 609.926256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.037287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.037817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.037817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.038272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.038443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.038600] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 is going to be created. [ 610.067090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.067312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.067312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.067528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.067700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.081662] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 in Status: UNINITIALIZED for 2s [ 610.204687] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c204a4b-a669-4fe4-b5e6-edacdb0d1270: rpc.has_security_group_logging(os_id): False [ 610.232106] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.232317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.232448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.232841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.232841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.233118] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.233264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.233361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.233785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.233785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.233915] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.234220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.234304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.234514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.234595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.234889] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.234981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.235096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.235217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.235316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.235409] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 is going to be created. [ 610.355213] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.355213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.355213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.355213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.355213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.375917] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 in Status: IN_PROGRESS for 2s [ 610.553025] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e3d2ccb9-9cab-4c78-9673-ab5e02ede958 None None] Enqueued Resource ID: fccfc04e-a0b6-401d-bca1-a40a26cc10af with Priority: HIGHEST for action port [ 610.553025] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fccfc04e-a0b6-401d-bca1-a40a26cc10af with Priority: HIGHEST for action port [ 610.553025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fccfc04e-a0b6-401d-bca1-a40a26cc10af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.553025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fccfc04e-a0b6-401d-bca1-a40a26cc10af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.553025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fccfc04e-a0b6-401d-bca1-a40a26cc10af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.553025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fccfc04e-a0b6-401d-bca1-a40a26cc10af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.554623] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fccfc04e-a0b6-401d-bca1-a40a26cc10af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.058941] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fccfc04e-a0b6-401d-bca1-a40a26cc10af [ 611.058941] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.058941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.058941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.058941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.058941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.058941] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fccfc04e-a0b6-401d-bca1-a40a26cc10af already deleted. [ 611.058941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fccfc04e-a0b6-401d-bca1-a40a26cc10af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.160032] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5061817-3e35-4521-a60a-7ba31153fa21 req-3cf0e03a-6399-44da-98ba-52986010234a tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 611.161261] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 611.161736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.161879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.162077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.162273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.162463] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.162597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.162648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.163344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.163459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.163554] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.533773] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.533969] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.534101] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.534442] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.534716] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.534877] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.534990] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.535666] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.535820] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.536042] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.536155] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.536261] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.536375] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.536481] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.536582] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.536707] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.572025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.572025] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.572025] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.572025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.572025] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-6e11344a-f036-4981-9b30-48ca1305e7cb taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.572025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.572025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.572025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.572025] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e11344a-f036-4981-9b30-48ca1305e7cb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.668348] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.668348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.668348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.668548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.668741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.668776] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.670525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.670525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.670525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.670525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.670525] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 already deleted. [ 611.670525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.072738] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.073219] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.073293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.073945] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.073945] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.074174] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 6e11344a-f036-4981-9b30-48ca1305e7cb not found, creating... [ 612.074453] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.074709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.074805] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.076097] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.076293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.076818] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.077119] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.077333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.077704] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.077961] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.078244] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 6e11344a-f036-4981-9b30-48ca1305e7cb is going to be created. [ 612.093767] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 in Status: SUCCESS [ 612.095774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.095774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.095774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.096906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.097115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.097189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.097384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.097474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.097648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.097714] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.106578] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.106869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.106908] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.107233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.107426] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.107648] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.389821] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 in Status: SUCCESS [ 612.390297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.590067] env[66131]: INFO networking_nsxv3.common.synchronization [req-a416e1b7-90dd-4b8b-b007-9e74bbd34256 req-fca30094-f027-48f9-9116-51a19889d1c6 tempest-DeleteServersAdminTestJSON-708695952 tempest-DeleteServersAdminTestJSON-708695952-project-admin] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 612.590676] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 612.590974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.591137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.591205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.591402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.591838] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.591838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.591838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.592027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.592064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.592166] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.600638] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.807612] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5061817-3e35-4521-a60a-7ba31153fa21 req-b184c161-5341-4ac2-8150-b971d90672c8 service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 612.807966] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5061817-3e35-4521-a60a-7ba31153fa21 req-b184c161-5341-4ac2-8150-b971d90672c8 service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 612.808308] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5061817-3e35-4521-a60a-7ba31153fa21 req-b184c161-5341-4ac2-8150-b971d90672c8 service nova] Enqueued Resource ID: 6e11344a-f036-4981-9b30-48ca1305e7cb with Priority: HIGHEST for action port [ 612.811941] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 612.811941] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 612.811941] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e11344a-f036-4981-9b30-48ca1305e7cb with Priority: HIGHEST for action port [ 612.811941] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.811941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.811941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.811941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.811941] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.817027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.817027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.817027] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.817027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e11344a-f036-4981-9b30-48ca1305e7cb taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.817027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.818419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.818744] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e11344a-f036-4981-9b30-48ca1305e7cb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.095218] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.095767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.095767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.095767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.095961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.096104] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.098091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.098091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.098091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.098091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.098091] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be updated. [ 613.104829] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b094a3d7-f106-4b6e-99e8-eb21f21b3609: rpc.has_security_group_logging(os_id): False [ 613.135511] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.135511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.135511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.135511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.135511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.135859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.135859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.135859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.135989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.135989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.136146] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 is going to be created. [ 613.142328] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.142614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.142614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.143370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.143370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.157515] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: IN_PROGRESS for 2s [ 613.236800] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.237342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.237457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.238033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.238261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.263714] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 in Status: IN_PROGRESS for 2s [ 613.321716] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.323312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.323312] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.323966] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e11344a-f036-4981-9b30-48ca1305e7cb with status ACTIVE [ 613.327091] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.327436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.327621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.328407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.328407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.329139] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.329139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.329139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.329348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.329483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.329956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.331422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.331422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.331617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.335029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.335029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e11344a-f036-4981-9b30-48ca1305e7cb is going to be updated. [ 613.416186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.416466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.416547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.416757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.416912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.417359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e11344a-f036-4981-9b30-48ca1305e7cb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.499956] env[66131]: INFO networking_nsxv3.common.synchronization [None req-a3a3d685-520c-41f2-831e-e7c1fb461a27 None None] Enqueued Resource ID: 264f4a21-bfb2-49f9-a8bd-2914ed648c9c with Priority: HIGHEST for action port [ 613.504036] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264f4a21-bfb2-49f9-a8bd-2914ed648c9c with Priority: HIGHEST for action port [ 613.504036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-264f4a21-bfb2-49f9-a8bd-2914ed648c9c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.504036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-264f4a21-bfb2-49f9-a8bd-2914ed648c9c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.504036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-264f4a21-bfb2-49f9-a8bd-2914ed648c9c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.504036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-264f4a21-bfb2-49f9-a8bd-2914ed648c9c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.504036] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('264f4a21-bfb2-49f9-a8bd-2914ed648c9c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.505747] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-74b1f41c-8815-4381-a5a1-1bd88f35fac9 tempest-ListServersNegativeTestJSON-681533543 tempest-ListServersNegativeTestJSON-681533543-project-member] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 613.509358] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 613.509358] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.509358] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.509358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.509358] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.835369] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.890536] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.890536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.890536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.890536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.890536] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.890536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.891196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.891998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.891998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.892212] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.892321] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.892425] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.892529] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.892634] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.892735] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.892859] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.915510] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.915767] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.915952] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.916253] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.916681] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.916960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.917310] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.917854] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.918043] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b13f8d0-ab47-4c44-87be-cdf2d76a4a03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.008649] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 264f4a21-bfb2-49f9-a8bd-2914ed648c9c [ 614.008956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.009115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.009115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.009398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.009537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.009671] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:264f4a21-bfb2-49f9-a8bd-2914ed648c9c already deleted. [ 614.009786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-264f4a21-bfb2-49f9-a8bd-2914ed648c9c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.010226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.010399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.010491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.010689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.010803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.011124] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.011211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.011211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.011847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.011847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.011847] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b already deleted. [ 614.011847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.338472] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.338472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.338472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.339144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.339144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.339144] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be created. [ 614.364780] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.364981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.365043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.365267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.365431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.376790] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: UNINITIALIZED for 2s [ 614.421878] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.421878] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.421878] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.422175] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.423024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.423341] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 not found, creating... [ 614.423847] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.424042] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.424191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.424550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.424715] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.425370] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.425533] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.425673] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.426041] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.426117] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.426207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 is going to be created. [ 614.449069] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.449307] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.449490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.449709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.449925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.450156] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.170369] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 615.170595] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf deletion is rescheduled due to dependency. [ 615.170735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.236130] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-9a0880d2-3f28-4f20-b5fe-ccc6a1734f79 service nova] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_rules [ 615.236431] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-9a0880d2-3f28-4f20-b5fe-ccc6a1734f79 service nova] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 615.236588] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-9a0880d2-3f28-4f20-b5fe-ccc6a1734f79 service nova] Enqueued Resource ID: 0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 with Priority: HIGHEST for action port [ 615.237319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_rules [ 615.237504] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 615.237633] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 with Priority: HIGHEST for action port [ 615.238087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.238230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.238326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.238679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.238789] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.239914] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.240064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.240111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.240280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.240502] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.240656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.240736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.240880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.240998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.241068] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.242237] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.242350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.242417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.242575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.242650] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b13f8d0-ab47-4c44-87be-cdf2d76a4a03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.285423] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 in Status: SUCCESS [ 615.285626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.637254] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-6ab647c4-4b71-4d59-8912-7d5014b57366 tempest-ListServersNegativeTestJSON-681533543 tempest-ListServersNegativeTestJSON-681533543-project-member] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 615.638858] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 615.638858] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.638858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.744033] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 with status ACTIVE [ 615.747259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.747259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.747259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.747259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.747259] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b13f8d0-ab47-4c44-87be-cdf2d76a4a03 is going to be updated. [ 615.751165] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.752359] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.753637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.778884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.778884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.778884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.778884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.778884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.778884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b13f8d0-ab47-4c44-87be-cdf2d76a4a03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.027988] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.027988] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.028235] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.028397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.028699] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.028879] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.028970] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.029230] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.029386] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.029878] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.030038] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.030258] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.030391] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.030681] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.030759] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.030870] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.060279] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.060519] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.060951] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.061196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.061532] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-43031a29-4318-4662-8c02-65fee50a87e7 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.061751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.062824] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.062824] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.062824] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43031a29-4318-4662-8c02-65fee50a87e7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.253843] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.386856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 616.387079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.387242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.387473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.387665] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.387784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.387849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.388019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.388095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.388180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.388288] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.565066] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.565435] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.565542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.565805] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.566060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.566213] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 43031a29-4318-4662-8c02-65fee50a87e7 not found, creating... [ 616.566400] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.566558] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.566756] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.566908] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.567068] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.567313] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.567483] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.567678] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.567913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.568177] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.568388] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 43031a29-4318-4662-8c02-65fee50a87e7 is going to be created. [ 616.591236] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.591567] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.591731] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.592020] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.592260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.592471] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.760761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.760761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.760761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.760761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.760761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.760761] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be created. [ 616.798180] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.798180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.798180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.798180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.798180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.823953] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: UNINITIALIZED for 2s [ 616.890631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.890845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.891017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.891176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.891361] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.891500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.891594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.891996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.891996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.891996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.892216] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.892216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.892295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.892407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.892545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.892650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.892709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.892848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.892944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.893147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.893147] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.187227] env[66131]: INFO networking_nsxv3.common.synchronization [None req-291669cc-d0dd-476b-866e-d156f71d94c0 tempest-ServersWithSpecificFlavorTestJSON-1087626551 tempest-ServersWithSpecificFlavorTestJSON-1087626551-project-member] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 617.187668] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 617.187968] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.188101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.188169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.188431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.188548] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.376483] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-122315f7-f2d9-4f87-a820-89b89709ef63 service nova] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_rules [ 617.376850] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-122315f7-f2d9-4f87-a820-89b89709ef63 service nova] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 617.377092] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-122315f7-f2d9-4f87-a820-89b89709ef63 service nova] Enqueued Resource ID: 43031a29-4318-4662-8c02-65fee50a87e7 with Priority: HIGHEST for action port [ 617.377809] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_rules [ 617.377975] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 617.378157] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43031a29-4318-4662-8c02-65fee50a87e7 with Priority: HIGHEST for action port [ 617.378521] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.378649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.378857] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.378939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.379152] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-43031a29-4318-4662-8c02-65fee50a87e7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.379261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.379329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.379551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.379633] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43031a29-4318-4662-8c02-65fee50a87e7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.398099] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e016bdc-1186-4d65-a6a4-b589ea567689: rpc.has_security_group_logging(os_id): False [ 617.419090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.419480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.419643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.419890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.420043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.420350] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.420498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.420645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.420886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.421030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.421371] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.421499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.421592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.421797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.421936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.422191] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.422320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.422406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.422673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.422804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.423017] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be created. [ 617.479029] env[66131]: INFO networking_nsxv3.common.synchronization [None req-9a279b25-4588-4253-a4d0-9ba1e548c431 tempest-ServersWithSpecificFlavorTestJSON-1087626551 tempest-ServersWithSpecificFlavorTestJSON-1087626551-project-member] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 617.479648] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 617.479991] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.480232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.489609] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.489790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.489867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.490139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.490335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.505123] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 617.714182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.714434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.714434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.714672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.714814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.714917] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f already deleted. [ 617.715618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.715618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.715618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.715618] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.882626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43031a29-4318-4662-8c02-65fee50a87e7 with status ACTIVE [ 617.883181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.883181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.883470] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.883638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.883927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.884263] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.884503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.884592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.884778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.884909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.885266] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.885428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.887106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.887106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.887106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.887106] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43031a29-4318-4662-8c02-65fee50a87e7 is going to be updated. [ 617.911352] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.911489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.911552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.911794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.911951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.912128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43031a29-4318-4662-8c02-65fee50a87e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.054663] env[66131]: INFO networking_nsxv3.common.synchronization [req-4efe8997-4e04-44c4-ae2d-3067aae9cf2e req-b59388f6-7b97-446f-90e6-780bba1f4cdf tempest-ServerDiagnosticsNegativeTest-739937943 tempest-ServerDiagnosticsNegativeTest-739937943-project-member] Enqueued Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_members [ 618.054663] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 with Priority: HIGHEST for action security_group_members [ 618.054663] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3affe7d0-eaa2-49d5-be04-f70f6d573297 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.054663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.054663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.055082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.055082] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.055082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.055082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.055263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.055352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.055456] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3affe7d0-eaa2-49d5-be04-f70f6d573297',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.239473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.239473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.239473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.239473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.239473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.239473] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f already deleted. [ 618.239473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.477661] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-f37d763e-3f9d-4583-a82e-9e5266887f8e tempest-ListServersNegativeTestJSON-681533543 tempest-ListServersNegativeTestJSON-681533543-project-member] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 618.478285] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 618.478649] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.478806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.558038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.558210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.558315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.558524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.558643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.558847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.559269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.559343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.559503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.559586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.559678] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 is going to be updated. [ 618.592359] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.592511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.592600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.592790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.592927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.605017] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 in Status: IN_PROGRESS for 2s [ 618.835074] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 618.835303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.835479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.835715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.836636] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.836636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.836636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.836636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.836636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.836636] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.329198] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.329198] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.329198] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.329554] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.329700] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.329848] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.329955] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.330583] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.330876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.331130] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.331236] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.331342] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.331443] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.331545] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.331643] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.331769] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.338414] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.372538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.372710] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.372847] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.373062] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.373385] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-516bac80-67f1-4194-8d0a-c1d2deb9daa3 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.373589] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.373781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.374130] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.374270] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('516bac80-67f1-4194-8d0a-c1d2deb9daa3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.458726] env[66131]: INFO networking_nsxv3.common.synchronization [req-843a60ac-2696-4de2-b5d5-86b5d3e51884 req-afa916b8-ac47-4049-944b-51146b461562 tempest-ServerExternalEventsTest-538923010 tempest-ServerExternalEventsTest-538923010-project-member] Enqueued Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_members [ 619.460050] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af with Priority: HIGHEST for action security_group_members [ 619.460050] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.460050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.460269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.460341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.460500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.460668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.460733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.460904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.461091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.461236] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('019f05d6-48e0-4ee7-bcb4-af4a1a2925af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.518108] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 619.518108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.840776] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.877719] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.877719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.877719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.877719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.877719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.877719] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 516bac80-67f1-4194-8d0a-c1d2deb9daa3 not found, creating... [ 619.877959] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.878019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.878341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.878341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.878569] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.878742] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.878876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.878984] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.879335] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.879501] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.879670] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 516bac80-67f1-4194-8d0a-c1d2deb9daa3 is going to be created. [ 619.902532] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.904054] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.905046] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.906064] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.906064] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.906064] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963639] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.963816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.963816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.964029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.964133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.964329] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.964421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.964486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.965203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.965203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.965203] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af is going to be updated. [ 620.002479] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.002741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.002741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.002945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.003109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.014568] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af in Status: IN_PROGRESS for 2s [ 620.345337] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.345337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.345337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.345337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.345337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.345337] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 620.373742] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.373822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.373822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.374057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.374236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.386662] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 620.620026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 in Status: SUCCESS [ 620.620450] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3affe7d0-eaa2-49d5-be04-f70f6d573297 deletion is rescheduled due to dependency. [ 620.620569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3affe7d0-eaa2-49d5-be04-f70f6d573297" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.660098] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-52fae6b9-9ae5-470a-9ebe-b789e888f4b3 service nova] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_rules [ 620.660318] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-52fae6b9-9ae5-470a-9ebe-b789e888f4b3 service nova] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 620.660453] env[66131]: INFO networking_nsxv3.common.synchronization [req-102716ac-3ff2-4c1a-8f2c-32be1413b6cd req-52fae6b9-9ae5-470a-9ebe-b789e888f4b3 service nova] Enqueued Resource ID: 516bac80-67f1-4194-8d0a-c1d2deb9daa3 with Priority: HIGHEST for action port [ 620.661051] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_rules [ 620.661381] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 620.661381] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 516bac80-67f1-4194-8d0a-c1d2deb9daa3 with Priority: HIGHEST for action port [ 620.661602] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.661765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.661989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.662378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.662736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-516bac80-67f1-4194-8d0a-c1d2deb9daa3 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.662825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.662825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.663389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.663389] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('516bac80-67f1-4194-8d0a-c1d2deb9daa3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.983272] env[66131]: INFO networking_nsxv3.common.synchronization [req-b208ca28-1b3c-4083-897a-98af7f174efc req-a3c2843e-9eb2-4cd1-8cf3-2a886e7a90e1 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 620.984286] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 620.986073] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.986073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.986073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.986073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.986316] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.986316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.986413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.986535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.986632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.987279] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.166147] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 516bac80-67f1-4194-8d0a-c1d2deb9daa3 with status ACTIVE [ 621.166444] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.166634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.166722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.167022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.167205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.167404] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.167615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.167615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.167809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.167915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.168180] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.168340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.168402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.168717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.168813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.168868] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 516bac80-67f1-4194-8d0a-c1d2deb9daa3 is going to be updated. [ 621.194423] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.195504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.195504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.195504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.196296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.196296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-516bac80-67f1-4194-8d0a-c1d2deb9daa3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.490141] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.490475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.490475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.490596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.490880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.491293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.491293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.491293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.491827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.491827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.491827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a already deleted. [ 621.491827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.539760] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.539760] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.539760] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.540499] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.540964] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.544018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.544018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.544018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.544018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.544018] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.544018] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.544018] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.544018] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.544018] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.544018] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.544018] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.565953] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.566186] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.566325] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.566506] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.566856] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.567112] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.567245] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.567963] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.567963] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6f0094-6a72-4095-9f25-3610cb3b5ff5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.025889] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af in Status: SUCCESS [ 622.026091] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 019f05d6-48e0-4ee7-bcb4-af4a1a2925af deletion is rescheduled due to dependency. [ 622.026225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-019f05d6-48e0-4ee7-bcb4-af4a1a2925af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.071090] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.071466] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.071898] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.072040] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.072205] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.072888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 1d6f0094-6a72-4095-9f25-3610cb3b5ff5 not found, creating... [ 622.072888] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.072888] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.073661] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.073661] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.073799] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.074152] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.074397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.074545] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.074862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.075186] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.075911] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 1d6f0094-6a72-4095-9f25-3610cb3b5ff5 is going to be created. [ 622.098428] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.099260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.099260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.100921] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.100921] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.100921] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.400013] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 622.400251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.400417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.400692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.400925] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.401190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.401263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.401425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.401508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.401640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.401754] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.402570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.402747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.402933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.403088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.403151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.403296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.403372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.403458] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.860331] env[66131]: INFO networking_nsxv3.common.synchronization [req-b208ca28-1b3c-4083-897a-98af7f174efc req-19c43074-9c3f-4c79-b1c8-636454249f87 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 622.860331] env[66131]: INFO networking_nsxv3.common.synchronization [req-b208ca28-1b3c-4083-897a-98af7f174efc req-19c43074-9c3f-4c79-b1c8-636454249f87 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 622.860331] env[66131]: INFO networking_nsxv3.common.synchronization [req-b208ca28-1b3c-4083-897a-98af7f174efc req-19c43074-9c3f-4c79-b1c8-636454249f87 service nova] Enqueued Resource ID: 1d6f0094-6a72-4095-9f25-3610cb3b5ff5 with Priority: HIGHEST for action port [ 622.860915] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 622.861013] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 622.861312] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6f0094-6a72-4095-9f25-3610cb3b5ff5 with Priority: HIGHEST for action port [ 622.861589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.861833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.861915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.862174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.862258] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.863376] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.863376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.863504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.863681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.863781] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.864377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.864377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.864377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.864515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.864515] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.865775] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.865775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.865914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.866415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.866415] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6f0094-6a72-4095-9f25-3610cb3b5ff5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.905091] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.905380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.905503] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.368222] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.368432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.368603] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.369664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d6f0094-6a72-4095-9f25-3610cb3b5ff5 with status ACTIVE [ 623.369763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.369889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.369889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.370084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.370174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.370345] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.370520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.370520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.370665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.370754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.370935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.371172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.371832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.371832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.371832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.371832] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d6f0094-6a72-4095-9f25-3610cb3b5ff5 is going to be updated. [ 623.395228] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.395930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.396039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.396253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.396394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.396559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d6f0094-6a72-4095-9f25-3610cb3b5ff5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.409158] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.873583] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.912843] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.913033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.913135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.913302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.913449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.913502] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 623.949670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.949670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.949670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.949851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.949933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.961340] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 624.032136] env[66131]: INFO networking_nsxv3.common.synchronization [req-cc4f668c-26a5-46df-ac42-a8753499bb3f req-98773555-7574-47e9-b801-ac5c51a9afcd tempest-TenantUsagesTestJSON-353583828 tempest-TenantUsagesTestJSON-353583828-project-member] Enqueued Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_members [ 624.032725] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d with Priority: HIGHEST for action security_group_members [ 624.036070] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.036070] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.036070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.036070] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88c2f217-48ed-4b9b-b2f8-5e8fec9e586d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.385122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.385122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.385122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.385122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.385122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.385122] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be created. [ 624.412248] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.412501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.412605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.413044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.413242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.430384] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: UNINITIALIZED for 2s [ 624.536889] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.538558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.538558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.538558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.538558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.538558] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.538558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.538558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.539512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.539615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.539710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d is going to be updated. [ 624.573322] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.573484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.573605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.574133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.574236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.585552] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d in Status: IN_PROGRESS for 2s [ 625.029049] env[66131]: INFO networking_nsxv3.common.synchronization [None req-868e61b8-2c3f-42cb-a05e-f5094af3b637 None None] Enqueued Resource ID: eb005e19-df7e-4c6e-b994-dc148170e316 with Priority: HIGHEST for action port [ 625.030336] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb005e19-df7e-4c6e-b994-dc148170e316 with Priority: HIGHEST for action port [ 625.033393] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb005e19-df7e-4c6e-b994-dc148170e316 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.033393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb005e19-df7e-4c6e-b994-dc148170e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.033393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb005e19-df7e-4c6e-b994-dc148170e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.033393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb005e19-df7e-4c6e-b994-dc148170e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.033393] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb005e19-df7e-4c6e-b994-dc148170e316',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.347839] env[66131]: INFO networking_nsxv3.common.synchronization [req-0b50e17b-2de4-4e5b-a54f-24a511acdad8 req-de649d73-d773-4487-8f18-2e597e42a991 tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 625.348949] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 625.349436] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.349735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.349735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.350092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.351564] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.351564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.351564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.351564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.351564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.351564] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.536348] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb005e19-df7e-4c6e-b994-dc148170e316 [ 625.536576] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.536669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.536725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.537273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.537273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.537273] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb005e19-df7e-4c6e-b994-dc148170e316 already deleted. [ 625.537273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb005e19-df7e-4c6e-b994-dc148170e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.854561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.854701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.854701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.857061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.857061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.857061] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.857061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.857061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.857883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.857883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.857883] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 already deleted. [ 625.857883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.973745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.973745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.973745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.973745] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.401509] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.401866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.402019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.402610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.402610] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.402778] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.403363] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.403954] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.404167] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.404413] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.404555] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.404998] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.404998] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.404998] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.405485] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.405670] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.431745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.431949] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.432103] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.432285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.432764] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-ab16f6a0-dc14-4111-ab30-817eed200e04 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.432896] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.433019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.433348] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.433513] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab16f6a0-dc14-4111-ab30-817eed200e04',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.448583] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 626.449273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.449273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.449273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.449421] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.449541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.449606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.449751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.449834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.449901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.449992] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.466963] env[66131]: INFO networking_nsxv3.common.synchronization [req-376a0049-c601-4a5e-9206-163d2cf3e916 req-809b771e-3233-45e4-a39c-a251e1f49b60 tempest-ImagesNegativeTestJSON-1023338767 tempest-ImagesNegativeTestJSON-1023338767-project-member] Enqueued Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_members [ 626.467739] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 with Priority: HIGHEST for action security_group_members [ 626.468157] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.468265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.468265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.468515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.468607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.468731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.468782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.468947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.469132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.469186] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c204a4b-a669-4fe4-b5e6-edacdb0d1270',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.476050] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.598214] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d in Status: SUCCESS [ 626.598400] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88c2f217-48ed-4b9b-b2f8-5e8fec9e586d deletion is rescheduled due to dependency. [ 626.598400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88c2f217-48ed-4b9b-b2f8-5e8fec9e586d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.939257] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.939511] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.939566] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.939857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.940025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.940192] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port ab16f6a0-dc14-4111-ab30-817eed200e04 not found, creating... [ 626.940455] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.940601] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.940750] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.941011] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.941139] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.941411] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.941557] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.941700] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.941871] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.942000] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.944550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: ab16f6a0-dc14-4111-ab30-817eed200e04 is going to be created. [ 626.952628] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.952896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.952991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.953451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.953682] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.953869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.953954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.954116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.954217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.954313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.954757] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.954908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.954988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.955250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.955343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.955424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.955482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.956364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.956499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.956977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.956977] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.968936] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.969255] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.969407] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.969772] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.970063] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.970396] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.971412] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.971581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.971658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.971892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.971993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.972209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.972308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.972372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.972535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.972617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.972703] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 is going to be updated. [ 626.978436] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.002606] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.002917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.003008] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.003227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.003368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.023602] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 in Status: IN_PROGRESS for 2s [ 627.439895] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2548db5e-57f1-41b8-a5e6-ceb921454744 None None] Enqueued Resource ID: b5390123-3ec6-425f-a35d-22900f5981da with Priority: HIGHEST for action port [ 627.441241] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5390123-3ec6-425f-a35d-22900f5981da with Priority: HIGHEST for action port [ 627.441241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5390123-3ec6-425f-a35d-22900f5981da taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.441241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5390123-3ec6-425f-a35d-22900f5981da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.441241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5390123-3ec6-425f-a35d-22900f5981da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.441433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5390123-3ec6-425f-a35d-22900f5981da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.441467] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5390123-3ec6-425f-a35d-22900f5981da',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.459944] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4e8c15-6df2-42fb-824c-bb556c5b499a: rpc.has_security_group_logging(os_id): False [ 627.481279] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.481430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.481502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.481910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.481910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.482056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.482125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.482163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.482322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.482403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.482627] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.482727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.482805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.482986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.483107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.483352] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.483457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.483529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.483673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.483751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.483838] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be created. [ 627.486068] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.486068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.486068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.486277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.486277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.486487] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 627.517816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.518038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.518122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.518446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.519213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.531350] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 627.551566] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.551566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.551566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.552139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.552139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.564844] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 627.694438] env[66131]: INFO networking_nsxv3.common.synchronization [req-0b50e17b-2de4-4e5b-a54f-24a511acdad8 req-f29dadfa-442c-4a19-a9ed-b449195d2c65 service nova] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_rules [ 627.694867] env[66131]: INFO networking_nsxv3.common.synchronization [req-0b50e17b-2de4-4e5b-a54f-24a511acdad8 req-f29dadfa-442c-4a19-a9ed-b449195d2c65 service nova] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 627.694867] env[66131]: INFO networking_nsxv3.common.synchronization [req-0b50e17b-2de4-4e5b-a54f-24a511acdad8 req-f29dadfa-442c-4a19-a9ed-b449195d2c65 service nova] Enqueued Resource ID: ab16f6a0-dc14-4111-ab30-817eed200e04 with Priority: HIGHEST for action port [ 627.695282] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_rules [ 627.695422] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 627.695585] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab16f6a0-dc14-4111-ab30-817eed200e04 with Priority: HIGHEST for action port [ 627.695796] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.695907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.695942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.696245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.696355] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.697384] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.697384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.697384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.697600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.697866] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.697866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.697866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.698575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.698575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.698575] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.699104] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab16f6a0-dc14-4111-ab30-817eed200e04 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.699214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.699783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.699783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.699783] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab16f6a0-dc14-4111-ab30-817eed200e04',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.944229] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5390123-3ec6-425f-a35d-22900f5981da [ 627.945268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.945432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.946041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.946041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.946041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.946041] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5390123-3ec6-425f-a35d-22900f5981da already deleted. [ 627.946041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5390123-3ec6-425f-a35d-22900f5981da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.025956] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e683707b-34f5-459c-a490-a48227f21421 None None] Enqueued Resource ID: 010ba429-692d-474a-9acb-4aeaf324bb15 with Priority: HIGHEST for action port [ 628.026247] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010ba429-692d-474a-9acb-4aeaf324bb15 with Priority: HIGHEST for action port [ 628.026840] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-010ba429-692d-474a-9acb-4aeaf324bb15 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.026965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-010ba429-692d-474a-9acb-4aeaf324bb15" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.027357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-010ba429-692d-474a-9acb-4aeaf324bb15" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.028206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-010ba429-692d-474a-9acb-4aeaf324bb15" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.028343] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('010ba429-692d-474a-9acb-4aeaf324bb15',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.201590] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.202075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.202385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.203441] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab16f6a0-dc14-4111-ab30-817eed200e04 with status ACTIVE [ 628.203788] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.204172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.204378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.204707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.205184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.207219] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.207219] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.207219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.207219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab16f6a0-dc14-4111-ab30-817eed200e04 is going to be updated. [ 628.232761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.232966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.233022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.234171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.234171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.234171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab16f6a0-dc14-4111-ab30-817eed200e04" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.531959] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 010ba429-692d-474a-9acb-4aeaf324bb15 [ 628.531959] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.531959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.532419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.532419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.532419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.532861] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:010ba429-692d-474a-9acb-4aeaf324bb15 already deleted. [ 628.532861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-010ba429-692d-474a-9acb-4aeaf324bb15" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.710319] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.034763] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 in Status: SUCCESS [ 629.035849] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c204a4b-a669-4fe4-b5e6-edacdb0d1270 deletion is rescheduled due to dependency. [ 629.035945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c204a4b-a669-4fe4-b5e6-edacdb0d1270" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.058867] env[66131]: INFO networking_nsxv3.common.synchronization [req-a961521f-65cd-4a8c-b748-d91c4ec40f08 req-8e3ac84f-15f1-4927-9662-ec053bb9b872 tempest-VolumesAdminNegativeTest-1339751475 tempest-VolumesAdminNegativeTest-1339751475-project-member] Enqueued Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_members [ 629.059395] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_members [ 629.059851] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.059954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.059954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.061085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.061085] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.061085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.061085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.061085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.061362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.061362] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.215596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.215765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.215859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.216763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.216763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.216763] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be created. [ 629.258023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.258023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.258023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.258023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.258023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.267060] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: UNINITIALIZED for 2s [ 629.558158] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.558158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.558158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.558158] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.567639] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.567848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.567931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.568258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.568367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.568724] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.568822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.568882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.570892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.570892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.570892] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 already deleted. [ 629.570892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.586959] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 629.586959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.684023] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.684023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-425" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.685502] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-425" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.685502] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-425" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.686386] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.686588] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.686708] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.686979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.687141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.687359] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.687474] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.687578] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.687681] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.687786] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.687892] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.688026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.708937] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.709191] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.709398] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.709608] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-425" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.710030] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-999622bf-1565-4abb-80d1-c6f110739935 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.710196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.710284] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.710618] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.710869] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999622bf-1565-4abb-80d1-c6f110739935',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.061832] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.168544] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ea137c89-cad8-4c25-b83d-fa28be035534 None None] Enqueued Resource ID: 4fea710b-727d-42a6-abec-5811cd7bab95 with Priority: HIGHEST for action port [ 630.168859] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fea710b-727d-42a6-abec-5811cd7bab95 with Priority: HIGHEST for action port [ 630.169158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fea710b-727d-42a6-abec-5811cd7bab95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.169346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fea710b-727d-42a6-abec-5811cd7bab95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.169425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fea710b-727d-42a6-abec-5811cd7bab95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.169710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fea710b-727d-42a6-abec-5811cd7bab95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.169786] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fea710b-727d-42a6-abec-5811cd7bab95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.214090] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.214261] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.215902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.215902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.215902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.215902] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 999622bf-1565-4abb-80d1-c6f110739935 not found, creating... [ 630.215902] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.215902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.215902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.216265] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.216265] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.217469] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.217469] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.217469] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.217469] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.217834] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.217984] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 999622bf-1565-4abb-80d1-c6f110739935 is going to be created. [ 630.239625] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.239833] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.239954] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.240260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.240514] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.240758] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.396649] env[66131]: INFO networking_nsxv3.common.synchronization [None req-80d4146d-1eb3-4efd-83ed-5237f501311d None None] Enqueued Resource ID: 79fa2f1d-0945-4875-982f-bf8e32ad19b0 with Priority: HIGHEST for action port [ 630.397026] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fa2f1d-0945-4875-982f-bf8e32ad19b0 with Priority: HIGHEST for action port [ 630.397569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-79fa2f1d-0945-4875-982f-bf8e32ad19b0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.397569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79fa2f1d-0945-4875-982f-bf8e32ad19b0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.397569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79fa2f1d-0945-4875-982f-bf8e32ad19b0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.398781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79fa2f1d-0945-4875-982f-bf8e32ad19b0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.398781] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fa2f1d-0945-4875-982f-bf8e32ad19b0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.566502] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.672659] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fea710b-727d-42a6-abec-5811cd7bab95 [ 630.672834] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.672973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.673078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.673314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.673407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.673522] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fea710b-727d-42a6-abec-5811cd7bab95 already deleted. [ 630.673608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fea710b-727d-42a6-abec-5811cd7bab95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.902538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79fa2f1d-0945-4875-982f-bf8e32ad19b0 [ 630.902780] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.902917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.904745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.904745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.905200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.906639] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79fa2f1d-0945-4875-982f-bf8e32ad19b0 already deleted. [ 630.906639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79fa2f1d-0945-4875-982f-bf8e32ad19b0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.942375] env[66131]: INFO networking_nsxv3.common.synchronization [req-a961521f-65cd-4a8c-b748-d91c4ec40f08 req-e19edeeb-f031-45c5-8e2c-b67a48550173 service nova] Enqueued Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_rules [ 630.942435] env[66131]: INFO networking_nsxv3.common.synchronization [req-a961521f-65cd-4a8c-b748-d91c4ec40f08 req-e19edeeb-f031-45c5-8e2c-b67a48550173 service nova] Enqueued Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_members [ 630.942719] env[66131]: INFO networking_nsxv3.common.synchronization [req-a961521f-65cd-4a8c-b748-d91c4ec40f08 req-e19edeeb-f031-45c5-8e2c-b67a48550173 service nova] Enqueued Resource ID: 999622bf-1565-4abb-80d1-c6f110739935 with Priority: HIGHEST for action port [ 630.942797] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_rules [ 630.942856] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_members [ 630.943159] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999622bf-1565-4abb-80d1-c6f110739935 with Priority: HIGHEST for action port [ 630.943500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.943665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.943708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.945423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.945423] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.945423] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.945423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.945423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.945423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.945639] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.945639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.945639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.945749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.945838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.946120] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.946736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-999622bf-1565-4abb-80d1-c6f110739935 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.946900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.946966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.948382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.948382] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999622bf-1565-4abb-80d1-c6f110739935',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.070475] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.070729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.070793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.071010] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.071203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.071260] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 631.110560] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.110767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.110842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.111077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.111242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.121491] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 631.289508] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 631.289926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.290234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.290532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.290833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.291073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.291162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.291423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.291556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.291656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.291768] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.449302] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.449472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.449755] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.450601] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 999622bf-1565-4abb-80d1-c6f110739935 with status ACTIVE [ 631.450849] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.450993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.451077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.451337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.451448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.451665] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.451830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.451909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.452048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.452120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.452287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.452442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.452638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.452638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.452743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.452794] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 999622bf-1565-4abb-80d1-c6f110739935 is going to be updated. [ 631.476339] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.476518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.476691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.476778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.476915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.477093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999622bf-1565-4abb-80d1-c6f110739935" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.796923] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.797281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.797281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.797551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.797780] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.797921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.798020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.798237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.798358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.798482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.798699] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.798835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.798905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.799128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.799320] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.799444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.799525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.799737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.799851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.799975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.800134] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.955550] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.303239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395c7bb1-0365-458d-a01e-64a431cc84a0: rpc.has_security_group_logging(os_id): False [ 632.326668] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.328978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.329172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.329365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.329507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.329813] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.330901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.331133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.331864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.331864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.331864] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.332430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.332797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.332885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.333047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.334253] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.334531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.334742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.335131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.335369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.336114] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be created. [ 632.400372] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.400526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.400588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.400832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.402539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.415138] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 632.457036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.457232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.457232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.457457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.457550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.457655] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 is going to be created. [ 632.566648] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.566860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.566904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.567125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.567292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.578635] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 in Status: UNINITIALIZED for 2s [ 632.637283] env[66131]: INFO networking_nsxv3.common.synchronization [None req-4279c870-34f5-4075-97c2-05593dd0bd4a None None] Enqueued Resource ID: 4664f796-de3c-41d8-b0fc-32faaa93a67d with Priority: HIGHEST for action port [ 632.637283] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4664f796-de3c-41d8-b0fc-32faaa93a67d with Priority: HIGHEST for action port [ 632.637283] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4664f796-de3c-41d8-b0fc-32faaa93a67d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.637283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4664f796-de3c-41d8-b0fc-32faaa93a67d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.637283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4664f796-de3c-41d8-b0fc-32faaa93a67d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.637737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4664f796-de3c-41d8-b0fc-32faaa93a67d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.637827] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4664f796-de3c-41d8-b0fc-32faaa93a67d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.141307] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 633.142061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.142061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4664f796-de3c-41d8-b0fc-32faaa93a67d [ 633.142389] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.142637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.142860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.143699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.143699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.143866] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4664f796-de3c-41d8-b0fc-32faaa93a67d already deleted. [ 633.143975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4664f796-de3c-41d8-b0fc-32faaa93a67d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.144208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.144423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.144735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.144919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.145035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.145183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.145266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.145352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.145513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.145610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.145666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.145824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.145967] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.146165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.146250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.146414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.146498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.146609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.146724] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.297030] env[66131]: INFO networking_nsxv3.common.synchronization [None req-61a82529-5495-402f-922f-d13fe7a72930 None None] Enqueued Resource ID: e8545aa0-7b4f-4ee1-ad76-6476a3f43b71 with Priority: HIGHEST for action port [ 633.297688] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8545aa0-7b4f-4ee1-ad76-6476a3f43b71 with Priority: HIGHEST for action port [ 633.298096] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8545aa0-7b4f-4ee1-ad76-6476a3f43b71 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.299239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8545aa0-7b4f-4ee1-ad76-6476a3f43b71" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.299239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8545aa0-7b4f-4ee1-ad76-6476a3f43b71" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.299239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8545aa0-7b4f-4ee1-ad76-6476a3f43b71" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.299239] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8545aa0-7b4f-4ee1-ad76-6476a3f43b71',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.424994] env[66131]: INFO networking_nsxv3.common.synchronization [req-018f1763-7696-47c8-a91f-23ab1ded378a req-a0c22de4-18e5-4ed7-a506-f7c933de91fb tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 633.426386] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 633.426494] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.426670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.426770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.427099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.427709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.427709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.427709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.427881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.427881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.427994] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.651875] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 091418bc-6d4e-4be2-bfdc-783bb4e9e92b: rpc.has_security_group_logging(os_id): False [ 633.672849] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.672849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.672849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.672849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.672849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.672849] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.673223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.673223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.673223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.673223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.673402] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.673500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.673560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.673699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.673777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.673960] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.674202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.674310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.674496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.674550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.674646] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be created. [ 633.736236] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.736994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.736994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.737126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.737357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.748455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 633.793942] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.795048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.795048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795048] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.795405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.795405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795855] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.796175] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.796326] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.796492] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.796619] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.796739] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.796903] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.797096] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.803293] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8545aa0-7b4f-4ee1-ad76-6476a3f43b71 [ 633.803531] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.803659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.803732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.804236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.804236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.804236] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8545aa0-7b4f-4ee1-ad76-6476a3f43b71 already deleted. [ 633.804236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8545aa0-7b4f-4ee1-ad76-6476a3f43b71" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.824263] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.824380] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.824524] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.824710] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.825037] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-5c989931-ccdf-45d7-9a69-21b45dac037a taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.825208] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.825323] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.825643] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.825777] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c989931-ccdf-45d7-9a69-21b45dac037a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.932940] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.330903] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.330903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.330903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.330903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.330903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.330903] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 5c989931-ccdf-45d7-9a69-21b45dac037a not found, creating... [ 634.330903] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.330903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.330903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.331624] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.331624] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.332022] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.332022] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.332213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.332568] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.332726] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.332869] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 5c989931-ccdf-45d7-9a69-21b45dac037a is going to be created. [ 634.358043] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.358043] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.358315] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.358419] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.358652] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.358953] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.429545] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 634.430541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439462] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.591645] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 in Status: SUCCESS [ 634.591645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.593834] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.593834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.593834] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.725723] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e2b3905d-379a-4e44-83a1-618e5357ed76 None None] Enqueued Resource ID: d3db0135-4545-4825-8b6b-b48a663fa5ee with Priority: HIGHEST for action port [ 634.730688] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db0135-4545-4825-8b6b-b48a663fa5ee with Priority: HIGHEST for action port [ 634.730688] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3db0135-4545-4825-8b6b-b48a663fa5ee taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.730688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3db0135-4545-4825-8b6b-b48a663fa5ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.730688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3db0135-4545-4825-8b6b-b48a663fa5ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.730688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3db0135-4545-4825-8b6b-b48a663fa5ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.730688] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3db0135-4545-4825-8b6b-b48a663fa5ee',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.736689] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ef910dd0-3f4c-48ec-a3a5-d5ccff446349 None None] Enqueued Resource ID: 77311963-008d-4911-87a4-0700733062d2 with Priority: HIGHEST for action port [ 634.737534] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77311963-008d-4911-87a4-0700733062d2 with Priority: HIGHEST for action port [ 634.737534] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-77311963-008d-4911-87a4-0700733062d2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.737534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77311963-008d-4911-87a4-0700733062d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.737674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77311963-008d-4911-87a4-0700733062d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.737957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77311963-008d-4911-87a4-0700733062d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.738060] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77311963-008d-4911-87a4-0700733062d2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.944273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.944503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.944503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.944724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.944817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.945328] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 634.981969] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.982289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.982289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.982878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.983077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.000212] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 635.095717] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.099027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.099027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.099027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.099027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.100228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.100228] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.113989] env[66131]: INFO networking_nsxv3.common.synchronization [req-018f1763-7696-47c8-a91f-23ab1ded378a req-aba8e8ec-a93f-4779-ab20-5486fa350f33 service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 635.114184] env[66131]: INFO networking_nsxv3.common.synchronization [req-018f1763-7696-47c8-a91f-23ab1ded378a req-aba8e8ec-a93f-4779-ab20-5486fa350f33 service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 635.114555] env[66131]: INFO networking_nsxv3.common.synchronization [req-018f1763-7696-47c8-a91f-23ab1ded378a req-aba8e8ec-a93f-4779-ab20-5486fa350f33 service nova] Enqueued Resource ID: 5c989931-ccdf-45d7-9a69-21b45dac037a with Priority: HIGHEST for action port [ 635.115910] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 635.115910] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 635.115910] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c989931-ccdf-45d7-9a69-21b45dac037a with Priority: HIGHEST for action port [ 635.119394] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.119553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.119636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.119807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.119891] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.120874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.121406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.122422] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c989931-ccdf-45d7-9a69-21b45dac037a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.122589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.124976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.124976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.125235] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c989931-ccdf-45d7-9a69-21b45dac037a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.233664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3db0135-4545-4825-8b6b-b48a663fa5ee [ 635.233664] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.233664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.233664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.233664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.233664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.233664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3db0135-4545-4825-8b6b-b48a663fa5ee already deleted. [ 635.233664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3db0135-4545-4825-8b6b-b48a663fa5ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.240029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77311963-008d-4911-87a4-0700733062d2 [ 635.240397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.241830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.241830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.241830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.241830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.241830] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77311963-008d-4911-87a4-0700733062d2 already deleted. [ 635.241830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77311963-008d-4911-87a4-0700733062d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.603854] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68b0c3cc-e225-461c-b4fa-14cf951098f5: rpc.has_security_group_logging(os_id): False [ 635.630500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.630500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.630500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.630500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.631528] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.631834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.632267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.633450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.633450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.633450] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 is going to be created. [ 635.634539] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.634539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.634814] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c989931-ccdf-45d7-9a69-21b45dac037a with status ACTIVE [ 635.635157] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.635365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.635510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.636442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.636638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.636897] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.637111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.637584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.637584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.637584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.637854] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.638069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.639275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.639275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.639275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.639275] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c989931-ccdf-45d7-9a69-21b45dac037a is going to be updated. [ 635.675692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.676232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.676359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.676672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.676860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.677161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c989931-ccdf-45d7-9a69-21b45dac037a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.730877] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.731093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.731462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.731661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.731940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.754530] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 in Status: IN_PROGRESS for 2s [ 635.768455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 635.768820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.769445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.769674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.769768] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.273606] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.273827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.273930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.274292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.274570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.274733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.274832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.275075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.275207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.275348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.275480] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.416352] env[66131]: INFO networking_nsxv3.common.synchronization [None req-a0327607-3ce5-4ff7-950a-73a68dd6858e tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_rules [ 636.417305] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_rules [ 636.417415] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.418306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.418306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.418306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.418306] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.584268] env[66131]: INFO networking_nsxv3.common.synchronization [None req-636fbd1b-367d-430c-a3e1-aea18c3b9c5a tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_rules [ 636.585230] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_rules [ 636.585588] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.585736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.778651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.779019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.779107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.779343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.779552] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.779654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.779745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.779897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.779992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.780138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.780297] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.780390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.780446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.780596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.780758] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.780943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.781028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.781158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.781253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.781352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.781447] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.947584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.947584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.947584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.947584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.947937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.947937] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 already deleted. [ 636.947937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.948137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.948306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.948418] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.011648] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 637.011850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.012032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.012281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.013856] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.013856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.013856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.014184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.014184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.014184] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.285042] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 091418bc-6d4e-4be2-bfdc-783bb4e9e92b: rpc.has_security_group_logging(os_id): False [ 637.309255] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.309409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.309480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.309704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.309802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.310008] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.310117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.310182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.310358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.310418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.310624] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.310709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.310774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.310994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.311187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.312598] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.312713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.312786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.312952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.313091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.313247] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 637.426487] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.426725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.426849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.427192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.427550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.448723] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 637.479268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.480457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.480457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.480542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.480810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.481218] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 already deleted. [ 637.481474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.517044] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.770097] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 in Status: SUCCESS [ 637.770314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.785263] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ba9979e2-90c5-48de-a343-6b2fde8704f6 None None] Enqueued Resource ID: 616c2ac6-40e5-470a-9305-ae664bc6c3f5 with Priority: HIGHEST for action port [ 637.785843] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 616c2ac6-40e5-470a-9305-ae664bc6c3f5 with Priority: HIGHEST for action port [ 637.786168] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-616c2ac6-40e5-470a-9305-ae664bc6c3f5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.786316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-616c2ac6-40e5-470a-9305-ae664bc6c3f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.786390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-616c2ac6-40e5-470a-9305-ae664bc6c3f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.786915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-616c2ac6-40e5-470a-9305-ae664bc6c3f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.786915] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('616c2ac6-40e5-470a-9305-ae664bc6c3f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.020576] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.091308] env[66131]: INFO networking_nsxv3.common.synchronization [req-782fcc71-515a-4891-a256-8112afffbf69 req-535746f1-1e88-460c-b616-eaf097ea921e tempest-FloatingIPsAssociationTestJSON-1405363732 tempest-FloatingIPsAssociationTestJSON-1405363732-project-member] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 638.091308] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 638.093040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.093040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.093040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.093040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.093040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.093040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.096324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.096324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.096324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.096324] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.291333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 616c2ac6-40e5-470a-9305-ae664bc6c3f5 [ 638.291609] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.291773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.291850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.292154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.292507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.292507] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:616c2ac6-40e5-470a-9305-ae664bc6c3f5 already deleted. [ 638.292629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-616c2ac6-40e5-470a-9305-ae664bc6c3f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.530581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.530581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.530581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.530581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.530581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.530581] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 638.578083] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.578083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.578083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.578083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.578083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.587493] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.587493] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.587493] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.589288] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.590382] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.590708] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.590894] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.591186] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.591933] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.591933] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.591933] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.591933] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.592167] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.592167] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.592297] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.592503] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.599061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 638.600018] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.600018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.600018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.600242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.600320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.600508] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.600604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.600664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.600913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.601082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.601163] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 already deleted. [ 638.601220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.620948] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.621217] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.621433] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.621433] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.621749] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-00330b27-de7a-4a3d-84fa-66d146290112 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.621914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.622178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.622372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.622490] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00330b27-de7a-4a3d-84fa-66d146290112',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.037525] env[66131]: INFO networking_nsxv3.common.synchronization [req-b81f662f-d099-453e-a357-856998681ade req-ba09c354-73a7-44f6-83c1-4e4c5398595d tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: e43741b3-13eb-4224-b7ce-946767c9fc8e with Priority: HIGHEST for action security_group_rules [ 639.037525] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e43741b3-13eb-4224-b7ce-946767c9fc8e with Priority: HIGHEST for action security_group_rules [ 639.038701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e43741b3-13eb-4224-b7ce-946767c9fc8e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.039171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e43741b3-13eb-4224-b7ce-946767c9fc8e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.039455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e43741b3-13eb-4224-b7ce-946767c9fc8e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.040053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e43741b3-13eb-4224-b7ce-946767c9fc8e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.040344] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e43741b3-13eb-4224-b7ce-946767c9fc8e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.127751] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.127751] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 00330b27-de7a-4a3d-84fa-66d146290112 not found, creating... [ 639.127751] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.127751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.128689] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.128689] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.128689] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.128689] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.128689] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.128965] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 00330b27-de7a-4a3d-84fa-66d146290112 is going to be created. [ 639.152225] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.152467] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.152589] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.152900] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.153213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.154021] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.471165] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 639.471436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.471616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.471889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.472047] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.569619] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.569768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.569842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.570086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.570183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.570282] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e43741b3-13eb-4224-b7ce-946767c9fc8e already deleted. [ 639.570366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e43741b3-13eb-4224-b7ce-946767c9fc8e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.854045] env[66131]: INFO networking_nsxv3.common.synchronization [req-782fcc71-515a-4891-a256-8112afffbf69 req-e0c669d9-d4e4-407e-be33-f1919d9c5a2b service nova] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_rules [ 639.854045] env[66131]: INFO networking_nsxv3.common.synchronization [req-782fcc71-515a-4891-a256-8112afffbf69 req-e0c669d9-d4e4-407e-be33-f1919d9c5a2b service nova] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 639.854045] env[66131]: INFO networking_nsxv3.common.synchronization [req-782fcc71-515a-4891-a256-8112afffbf69 req-e0c669d9-d4e4-407e-be33-f1919d9c5a2b service nova] Enqueued Resource ID: 00330b27-de7a-4a3d-84fa-66d146290112 with Priority: HIGHEST for action port [ 639.854045] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_rules [ 639.854045] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 639.854045] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00330b27-de7a-4a3d-84fa-66d146290112 with Priority: HIGHEST for action port [ 639.854045] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.854045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.854045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.855141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.855388] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.856426] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.856754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.857420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.857628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.857794] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.857890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.857950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.858119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.858208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.858314] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.859291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-00330b27-de7a-4a3d-84fa-66d146290112 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.859626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.859626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.859757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.859803] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00330b27-de7a-4a3d-84fa-66d146290112',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.974424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.974629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.974738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.974952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.975409] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.975409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.975409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.975609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.975609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.975609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.975739] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.362602] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.362602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.362602] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.366836] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00330b27-de7a-4a3d-84fa-66d146290112 with status ACTIVE [ 640.367059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.367242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.367342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.367643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.367786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.368013] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.368146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.368272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.368403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.368482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.368670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.368764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.368880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.368955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.369046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.369806] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00330b27-de7a-4a3d-84fa-66d146290112 is going to be updated. [ 640.412963] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.412963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.412963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.412963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.413529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.413529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00330b27-de7a-4a3d-84fa-66d146290112" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.481612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.481780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.481780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.482214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.482214] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.482333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.482451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.482558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.482686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.482746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.482876] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.483097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.483097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.483362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.483362] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.483551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.483551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.483721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.483721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.483721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.483863] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.610068] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 640.610335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.610476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.610782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.611031] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.611157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.611219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.611380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.611622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.611622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.611732] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.867742] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.988945] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 091418bc-6d4e-4be2-bfdc-783bb4e9e92b: rpc.has_security_group_logging(os_id): False [ 641.013349] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.013349] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.013349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.013872] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.013872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.013872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.013872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.013872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.014154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.014213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.014256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.014410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.014491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.014582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 641.087112] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.087491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.087623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.087888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.088139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.107992] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 641.118627] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.119027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.119027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.119277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.119398] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.119496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.119565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.119950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.119950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.119950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.120164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.120164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.120250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.120371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.120571] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.120643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.120643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.120779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.120912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.120990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.122144] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.373606] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.373964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.373964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.374080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.374180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.374455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be created. [ 641.410332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.410576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.410659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.410908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.412131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.422834] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: UNINITIALIZED for 2s [ 641.624435] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e016bdc-1186-4d65-a6a4-b589ea567689: rpc.has_security_group_logging(os_id): False [ 641.643839] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.644044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.644106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.644386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.644493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.644763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.644900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.644987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.645226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.645344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.645572] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.645672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.645735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.645905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.646018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.646239] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.646410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.646455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.646602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.646674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.646760] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 641.717743] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.717890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.717931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.718209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.718411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.733750] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 642.936550] env[66131]: INFO networking_nsxv3.common.synchronization [req-976ee19f-0c9c-4cb1-a285-0e0cecbad11c req-0aeb2c15-c322-4167-9522-bb8b058a634d tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 642.937127] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 642.937465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.937610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.937669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.937840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.938019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.938117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.938187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.938304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.938390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.938482] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.006707] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5ff3ef2-846c-452b-bbf3-77194acf08c9 req-51d78dd9-649c-4f38-ad8a-673ed287921b tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: b4cca322-3708-427a-8a55-909927317967 with Priority: HIGHEST for action security_group_rules [ 643.006707] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4cca322-3708-427a-8a55-909927317967 with Priority: HIGHEST for action security_group_rules [ 643.006707] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4cca322-3708-427a-8a55-909927317967 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.007257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4cca322-3708-427a-8a55-909927317967" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.007257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4cca322-3708-427a-8a55-909927317967" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.007257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4cca322-3708-427a-8a55-909927317967" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.007257] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4cca322-3708-427a-8a55-909927317967',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.125630] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 643.126722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.441163] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 643.441416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.441823] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.442050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.442050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.442227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.442380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.442823] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.442823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.442823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.442823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.443556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.443556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 643.445598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.449475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.449567] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.449773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.449773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.450284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.450284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.450284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.450526] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.497057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.497229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.497303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.497563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.497777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.509332] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 643.539974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.539974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.539974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.539974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.539974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.540291] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4cca322-3708-427a-8a55-909927317967 already deleted. [ 643.540291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4cca322-3708-427a-8a55-909927317967" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.748038] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 643.748578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.953884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.954204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.954204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.956655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.956655] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.956655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.956655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.956655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.956655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.956655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.956655] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.957037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.957037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.957671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.957671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.957671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.957875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.957875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.957946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.958253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.959142] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.462500] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5c2151-bad2-47ce-a462-d37d0b06e5f6: rpc.has_security_group_logging(os_id): False [ 644.485108] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.485270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.485339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.485603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.485687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.485911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.486241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.486241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.486332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.486498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.486581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.486686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.486744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.486928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.487882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.488275] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.488416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.488743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.488743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.488743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.488905] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be created. [ 644.549370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.549693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.549693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.549849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.550097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.563760] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: IN_PROGRESS for 2s [ 645.131925] env[66131]: INFO networking_nsxv3.common.synchronization [req-1f5f4497-1454-4b38-bcc5-39a6ceb17de6 req-8e337d1c-a316-40d2-ba0b-099e0b99952e tempest-ListServersNegativeTestJSON-681533543 tempest-ListServersNegativeTestJSON-681533543-project-member] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 645.132616] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 645.133040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.133620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.133739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.134055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.134298] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.134482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.134723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.134995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.135160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.135323] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.520761] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 645.520761] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 645.520761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.641541] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.127901] env[66131]: INFO networking_nsxv3.common.synchronization [req-cdce6176-43bd-48f3-a907-06dbdb5ca758 req-aa6469ba-dd06-4852-8fa7-29dd0a3b6b83 tempest-ServersAdminNegativeTestJSON-1386696782 tempest-ServersAdminNegativeTestJSON-1386696782-project-member] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 646.130163] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 646.130569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.130711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.130775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.131132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.131303] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.131407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.131463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.131779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.131779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.131779] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.143465] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.219208] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f539659e-2bab-4d5a-b165-779a6d7121a7 None None] Enqueued Resource ID: d98d3901-8ee5-4a54-94c1-de8130e9e72b with Priority: HIGHEST for action port [ 646.219208] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d98d3901-8ee5-4a54-94c1-de8130e9e72b with Priority: HIGHEST for action port [ 646.219208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d98d3901-8ee5-4a54-94c1-de8130e9e72b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.219208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d98d3901-8ee5-4a54-94c1-de8130e9e72b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.219208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d98d3901-8ee5-4a54-94c1-de8130e9e72b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.219208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d98d3901-8ee5-4a54-94c1-de8130e9e72b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.219208] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98d3901-8ee5-4a54-94c1-de8130e9e72b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.545430] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.545430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.545430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.545430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.546268] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.546494] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.546613] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.547038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.547239] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.547806] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.547806] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.547806] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.547952] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.547952] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.548048] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.548179] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.571814] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.571999] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.572126] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.572299] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.572604] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.572771] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.573329] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.573329] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.573479] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b7d40a-eeb0-4c0d-9d0b-77df122ce252',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.576873] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 646.576873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.634899] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.635134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.635134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.635944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.635944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.635944] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.635944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.635944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.636154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.636154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.636219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce already deleted. [ 646.637025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.646026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.646193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.646233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.646454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.646541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.646977] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 646.679288] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.679288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.679288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.679288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.679288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.691698] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 646.724256] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d98d3901-8ee5-4a54-94c1-de8130e9e72b [ 646.724482] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.724612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.724713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.724909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.725016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.725415] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d98d3901-8ee5-4a54-94c1-de8130e9e72b already deleted. [ 646.725415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d98d3901-8ee5-4a54-94c1-de8130e9e72b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.078085] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.078324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.078441] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.078706] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.078869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.079112] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 18b7d40a-eeb0-4c0d-9d0b-77df122ce252 not found, creating... [ 647.079415] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.079591] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.079727] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.079960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.080060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.080341] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.080490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.080651] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.080802] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.081162] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.081380] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 18b7d40a-eeb0-4c0d-9d0b-77df122ce252 is going to be created. [ 647.105750] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.105946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.106104] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.106354] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.106582] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.110176] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.852960] env[66131]: INFO networking_nsxv3.common.synchronization [req-cdce6176-43bd-48f3-a907-06dbdb5ca758 req-58e75a5e-2e7e-444b-81f2-dc4cc744d898 service nova] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_rules [ 647.853377] env[66131]: INFO networking_nsxv3.common.synchronization [req-cdce6176-43bd-48f3-a907-06dbdb5ca758 req-58e75a5e-2e7e-444b-81f2-dc4cc744d898 service nova] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 647.853377] env[66131]: INFO networking_nsxv3.common.synchronization [req-cdce6176-43bd-48f3-a907-06dbdb5ca758 req-58e75a5e-2e7e-444b-81f2-dc4cc744d898 service nova] Enqueued Resource ID: 18b7d40a-eeb0-4c0d-9d0b-77df122ce252 with Priority: HIGHEST for action port [ 647.853901] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_rules [ 647.854664] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 647.854777] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b7d40a-eeb0-4c0d-9d0b-77df122ce252 with Priority: HIGHEST for action port [ 647.855073] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.855262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.855319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.855558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.855644] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.856578] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.856723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.856793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.856984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.857291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.857291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.857484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.857522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.857616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.857709] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.860589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.860589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.860686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.861438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.861438] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b7d40a-eeb0-4c0d-9d0b-77df122ce252',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.363318] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.363501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.363750] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.365344] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18b7d40a-eeb0-4c0d-9d0b-77df122ce252 with status ACTIVE [ 648.365616] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.365780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.365850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.366170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.366295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.366546] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.366658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.366723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.366886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.366969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.367171] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.367295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.367363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.367554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.367663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.368090] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18b7d40a-eeb0-4c0d-9d0b-77df122ce252 is going to be updated. [ 648.391194] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.391550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.391550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.391629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.391748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.391951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18b7d40a-eeb0-4c0d-9d0b-77df122ce252" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.451793] env[66131]: INFO networking_nsxv3.common.synchronization [None req-3f820d50-194f-428e-9a7e-ebeedf036d26 None None] Enqueued Resource ID: 1bd86df8-a0fe-4eab-8552-6566c48a77d2 with Priority: HIGHEST for action port [ 648.456184] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd86df8-a0fe-4eab-8552-6566c48a77d2 with Priority: HIGHEST for action port [ 648.456860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bd86df8-a0fe-4eab-8552-6566c48a77d2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.457251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bd86df8-a0fe-4eab-8552-6566c48a77d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.457251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bd86df8-a0fe-4eab-8552-6566c48a77d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.457401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bd86df8-a0fe-4eab-8552-6566c48a77d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.457401] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bd86df8-a0fe-4eab-8552-6566c48a77d2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.705569] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 648.705787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.870844] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.959846] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bd86df8-a0fe-4eab-8552-6566c48a77d2 [ 648.959846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.960130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.960130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.960271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.960349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.960449] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bd86df8-a0fe-4eab-8552-6566c48a77d2 already deleted. [ 648.960531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bd86df8-a0fe-4eab-8552-6566c48a77d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.374109] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.374248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.374364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.375027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.375027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.375027] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be created. [ 649.402014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.402239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.402312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.402532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.402708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.415506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: UNINITIALIZED for 2s [ 649.728169] env[66131]: INFO networking_nsxv3.common.synchronization [None req-c4c5f371-da7e-41bf-a66a-b7723248e026 None None] Enqueued Resource ID: e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2 with Priority: HIGHEST for action port [ 649.728520] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2 with Priority: HIGHEST for action port [ 649.728837] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.728965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.729669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.730038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.730180] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.233868] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2 [ 650.233868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.233868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.233868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.234260] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.234296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.234472] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2 already deleted. [ 650.234587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d7bd1e-8b5c-42a9-ab35-7d1c4959a8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.486665] env[66131]: INFO networking_nsxv3.common.synchronization [None req-a3ebdd19-21e1-4d41-b572-26df394ea8bf None None] Enqueued Resource ID: 4f18d5bb-b9df-4430-8a71-aa5ecf3e4737 with Priority: HIGHEST for action port [ 650.486665] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f18d5bb-b9df-4430-8a71-aa5ecf3e4737 with Priority: HIGHEST for action port [ 650.486825] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f18d5bb-b9df-4430-8a71-aa5ecf3e4737 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.488020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f18d5bb-b9df-4430-8a71-aa5ecf3e4737" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.488020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f18d5bb-b9df-4430-8a71-aa5ecf3e4737" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.488020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f18d5bb-b9df-4430-8a71-aa5ecf3e4737" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.488020] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f18d5bb-b9df-4430-8a71-aa5ecf3e4737',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.990494] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f18d5bb-b9df-4430-8a71-aa5ecf3e4737 [ 650.990758] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.990873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.990962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.991210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.991304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.991398] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f18d5bb-b9df-4430-8a71-aa5ecf3e4737 already deleted. [ 650.991500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f18d5bb-b9df-4430-8a71-aa5ecf3e4737" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.333564] env[66131]: INFO networking_nsxv3.common.synchronization [req-7a629efe-78aa-48c7-8a36-dd2f7d462a5c req-5ee28a0b-3c37-4033-9930-067686ec4581 tempest-ServersWithSpecificFlavorTestJSON-1087626551 tempest-ServersWithSpecificFlavorTestJSON-1087626551-project-member] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 651.334257] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 651.334407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.334522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.334588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.334827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.334987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.336405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.336405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.336405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.336405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.336405] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.428659] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 651.428875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.429098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.429335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.429525] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.429640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.429704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.429857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.429944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.430033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.430125] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.837943] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.838441] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.838441] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.838605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.839025] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.839025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.839176] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.839385] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.839538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.839866] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.840018] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.840143] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.840292] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.840371] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.840466] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.840587] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.842120] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.842256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.842309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.842465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.842552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.842715] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.842809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.842870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.843021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.843095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.843179] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f already deleted. [ 651.843269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.865266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.865266] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.865266] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.865266] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.865266] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-31889c7f-7257-4ba9-a402-7cda0e8e2bac taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.865266] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.865266] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.866486] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.866651] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31889c7f-7257-4ba9-a402-7cda0e8e2bac',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.936676] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.936919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.937192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.937580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.937842] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.938114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.938777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.938777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.938777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.938777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.939164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.939164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.939246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.939783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.939884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.940147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.940147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.940387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.940491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.940630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.940805] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.250322] env[66131]: INFO networking_nsxv3.common.synchronization [req-a9a7cd34-c02c-45a3-9539-14563197f8b6 req-0015827f-8def-4580-960d-53aa840c33f6 tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: 0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86 with Priority: HIGHEST for action security_group_rules [ 652.252591] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86 with Priority: HIGHEST for action security_group_rules [ 652.252591] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.252591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.252591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.252591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.252591] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.371962] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.371962] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.371962] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.372405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.372405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.372675] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 31889c7f-7257-4ba9-a402-7cda0e8e2bac not found, creating... [ 652.375379] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.375379] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.375379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.375831] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 31889c7f-7257-4ba9-a402-7cda0e8e2bac is going to be created. [ 652.396576] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.396833] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.396901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.397318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.397429] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.397725] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.444320] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0923c94e-4f06-4310-bba9-cc69436848ce: rpc.has_security_group_logging(os_id): False [ 652.467227] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.467385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.467453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.467668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.467759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.467976] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.468112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.468176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.468378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.468452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.468683] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.468782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.468859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.469110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.469219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.469564] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.469564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.469651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.469747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.469835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.469940] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be created. [ 652.520672] env[66131]: INFO networking_nsxv3.common.synchronization [None req-3bfebeaa-cbf5-4528-abb4-92280e3f7586 None None] Enqueued Resource ID: 6ecbf4cf-402a-4af9-8862-6f039de51b59 with Priority: HIGHEST for action port [ 652.521283] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ecbf4cf-402a-4af9-8862-6f039de51b59 with Priority: HIGHEST for action port [ 652.521595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ecbf4cf-402a-4af9-8862-6f039de51b59 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.521710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ecbf4cf-402a-4af9-8862-6f039de51b59" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.522273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ecbf4cf-402a-4af9-8862-6f039de51b59" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.522273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ecbf4cf-402a-4af9-8862-6f039de51b59" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.522624] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ecbf4cf-402a-4af9-8862-6f039de51b59',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.556658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.556937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.556937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.557267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.557353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.570876] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: IN_PROGRESS for 2s [ 652.654660] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6003b82f-b1ac-491a-8fec-d66cdeccf25f None None] Enqueued Resource ID: dece3cdb-f7f6-4d69-950f-c11866d53fe7 with Priority: HIGHEST for action port [ 652.655307] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dece3cdb-f7f6-4d69-950f-c11866d53fe7 with Priority: HIGHEST for action port [ 652.656064] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-dece3cdb-f7f6-4d69-950f-c11866d53fe7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.656212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dece3cdb-f7f6-4d69-950f-c11866d53fe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.656274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dece3cdb-f7f6-4d69-950f-c11866d53fe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.656610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dece3cdb-f7f6-4d69-950f-c11866d53fe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.656722] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dece3cdb-f7f6-4d69-950f-c11866d53fe7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.778449] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.778449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.778449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.778449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.778702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.779419] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86 already deleted. [ 652.779419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cd9a5b3-d688-4fe8-b0af-8b3b9af94f86" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.027357] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ecbf4cf-402a-4af9-8862-6f039de51b59 [ 653.027357] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.027357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.027357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.027357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.027357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.027357] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ecbf4cf-402a-4af9-8862-6f039de51b59 already deleted. [ 653.027357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ecbf4cf-402a-4af9-8862-6f039de51b59" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.159146] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dece3cdb-f7f6-4d69-950f-c11866d53fe7 [ 653.160131] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.160320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.160402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.160658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.160713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.160883] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dece3cdb-f7f6-4d69-950f-c11866d53fe7 already deleted. [ 653.161038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dece3cdb-f7f6-4d69-950f-c11866d53fe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.260275] env[66131]: INFO networking_nsxv3.common.synchronization [req-7a629efe-78aa-48c7-8a36-dd2f7d462a5c req-97b77a5e-7585-421b-b913-ca258796d064 service nova] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 653.260834] env[66131]: INFO networking_nsxv3.common.synchronization [req-7a629efe-78aa-48c7-8a36-dd2f7d462a5c req-97b77a5e-7585-421b-b913-ca258796d064 service nova] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 653.260834] env[66131]: INFO networking_nsxv3.common.synchronization [req-7a629efe-78aa-48c7-8a36-dd2f7d462a5c req-97b77a5e-7585-421b-b913-ca258796d064 service nova] Enqueued Resource ID: 31889c7f-7257-4ba9-a402-7cda0e8e2bac with Priority: HIGHEST for action port [ 653.261591] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 653.262255] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 653.262255] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31889c7f-7257-4ba9-a402-7cda0e8e2bac with Priority: HIGHEST for action port [ 653.262388] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.262508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.262555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.263011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.263011] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.265662] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.265662] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.265662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.265662] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.266946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-31889c7f-7257-4ba9-a402-7cda0e8e2bac taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.266946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.266946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.266946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.266946] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31889c7f-7257-4ba9-a402-7cda0e8e2bac',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.769359] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.769359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.769359] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.769856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31889c7f-7257-4ba9-a402-7cda0e8e2bac with status ACTIVE [ 653.769856] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.769856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.769856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.770183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.770183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.770395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.770500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.770500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.770636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.770711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.770894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.771112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.771112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.771235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.771416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.771416] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31889c7f-7257-4ba9-a402-7cda0e8e2bac is going to be updated. [ 653.799110] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.799216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.799287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.799928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31889c7f-7257-4ba9-a402-7cda0e8e2bac" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.067628] env[66131]: INFO networking_nsxv3.common.synchronization [req-81ed9f31-bbff-455b-81ba-179761b94795 req-a35cdbd3-f83c-4f95-8a37-282cc76466b9 tempest-VolumesAdminNegativeTest-1339751475 tempest-VolumesAdminNegativeTest-1339751475-project-member] Enqueued Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_members [ 654.067739] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGHEST for action security_group_members [ 654.068170] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.068170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.068333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.068466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.069701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.069701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.069701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.069701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.069701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.069701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.274032] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.426121] env[66131]: INFO networking_nsxv3.common.synchronization [None req-37d68ed0-6833-4d3d-8b67-ff752a3909b5 tempest-ServersTestBootFromVolume-1636949881 tempest-ServersTestBootFromVolume-1636949881-project-member] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_rules [ 654.426541] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_rules [ 654.426849] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.426967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.427037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.427303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.427385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.566289] env[66131]: INFO networking_nsxv3.common.synchronization [None req-d89c7567-9960-4b5e-b091-bcd82ff98439 tempest-ServersTestBootFromVolume-1636949881 tempest-ServersTestBootFromVolume-1636949881-project-member] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_rules [ 654.566289] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_rules [ 654.566605] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.566705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.572890] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.573119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.573119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.573343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.573798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.573798] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.574080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.574080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.574156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.574339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.574339] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 is going to be updated. [ 654.586433] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 654.586670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.604272] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.604272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.604272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.604463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.605338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.614898] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 in Status: IN_PROGRESS for 2s [ 654.776718] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.777032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.777032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.777887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.777887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.777887] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be created. [ 654.805170] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.805429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.805429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.805654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.805779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.819630] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: UNINITIALIZED for 2s [ 654.952576] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.952972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.952972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.953204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.953332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.953443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 already deleted. [ 654.953556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.953757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.953974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.954426] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.487034] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.487034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.487034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.487034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.487034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.487363] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 already deleted. [ 655.487363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.856829] env[66131]: INFO networking_nsxv3.common.synchronization [req-7c2ba7a9-f740-42e7-a4e1-fbd4a718297d req-a83a0bae-4b46-4fc1-a414-58897a9f3aa3 tempest-AttachInterfacesV270Test-804379305 tempest-AttachInterfacesV270Test-804379305-project-member] Enqueued Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_members [ 655.857604] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_members [ 655.857922] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.858061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.858126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.858518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.858692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.858964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.859140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.859400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.859493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.859594] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.365102] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.365303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.365462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.365756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.366039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.366299] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.366480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.366587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.366936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.367094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.367247] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a already deleted. [ 656.367667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.418979] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.419293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-548" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.419449] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-548" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.419852] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-548" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.420241] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.420422] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.420556] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.420811] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.421059] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.421359] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.421501] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.421623] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.421775] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.422033] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.422132] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.422335] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.445948] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.446217] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.446428] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.446636] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-548" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.446935] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-7cc9f244-f926-4d09-8073-12cc36a1383f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.447256] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.447399] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.447779] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.447958] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc9f244-f926-4d09-8073-12cc36a1383f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.624726] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 in Status: SUCCESS [ 656.624929] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 deletion is rescheduled due to dependency. [ 656.625076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.830274] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 656.830577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.831209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.831209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.831346] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.831346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.831439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.831620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.831699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.831787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.831882] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.951936] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.951936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.951936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.951936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.951936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.951936] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 7cc9f244-f926-4d09-8073-12cc36a1383f not found, creating... [ 656.951936] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.951936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.952685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.952685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.952685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.952960] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.953142] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.953260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.953488] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.953669] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.953794] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 7cc9f244-f926-4d09-8073-12cc36a1383f is going to be created. [ 656.978659] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.978659] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.979709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.979709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.979709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.979709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.336149] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.810037] env[66131]: INFO networking_nsxv3.common.synchronization [req-7c2ba7a9-f740-42e7-a4e1-fbd4a718297d req-71e4b26f-605a-4aa9-97b8-8f329f3a974d service nova] Enqueued Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_rules [ 657.810239] env[66131]: INFO networking_nsxv3.common.synchronization [req-7c2ba7a9-f740-42e7-a4e1-fbd4a718297d req-71e4b26f-605a-4aa9-97b8-8f329f3a974d service nova] Enqueued Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_members [ 657.810332] env[66131]: INFO networking_nsxv3.common.synchronization [req-7c2ba7a9-f740-42e7-a4e1-fbd4a718297d req-71e4b26f-605a-4aa9-97b8-8f329f3a974d service nova] Enqueued Resource ID: 7cc9f244-f926-4d09-8073-12cc36a1383f with Priority: HIGHEST for action port [ 657.810903] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_rules [ 657.811025] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_members [ 657.811204] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9f244-f926-4d09-8073-12cc36a1383f with Priority: HIGHEST for action port [ 657.811591] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.811667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.811720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.811951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.812082] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.812895] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.813064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.813105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.813265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.813473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.813577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.813631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.813916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.813916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.814049] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.814904] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc9f244-f926-4d09-8073-12cc36a1383f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.814904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.814904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.815201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.815201] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc9f244-f926-4d09-8073-12cc36a1383f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.838466] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f3bfadc-ee4e-4dd7-a668-86025968cc1f: rpc.has_security_group_logging(os_id): False [ 657.856987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.857184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.857266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.857429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.857523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.857807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.857911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.857976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.858143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.858223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.858311] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be created. [ 657.922939] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.922939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.922939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.922939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.922939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.936232] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: IN_PROGRESS for 2s [ 658.437911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.437911] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.437911] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cc9f244-f926-4d09-8073-12cc36a1383f with status ACTIVE [ 658.437911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.437911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.437911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.441333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.441333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cc9f244-f926-4d09-8073-12cc36a1383f is going to be updated. [ 658.441333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.441333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc9f244-f926-4d09-8073-12cc36a1383f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.704625] env[66131]: INFO networking_nsxv3.common.synchronization [req-4ff8506d-8567-4691-9669-0281057d7426 req-82e849f4-c552-40f1-8ff0-7fe0250271c8 tempest-FloatingIPsAssociationNegativeTestJSON-937727895 tempest-FloatingIPsAssociationNegativeTestJSON-937727895-project-member] Enqueued Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_members [ 658.705591] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_members [ 658.705987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.706639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.706639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.706873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.706873] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.706974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.707151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.707208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.707279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.707373] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.831370] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.210062] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.210583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.210733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.213751] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.213751] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fc9052-f286-4d53-8d9d-b976649d992e already deleted. [ 659.213751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.228150] env[66131]: INFO networking_nsxv3.common.synchronization [req-958e5509-0817-4620-834d-e72fc123c211 req-b20e12db-826f-4eda-a577-c5d9f99db98a tempest-ServersTestManualDisk-878576868 tempest-ServersTestManualDisk-878576868-project-member] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_members [ 659.228770] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGHEST for action security_group_members [ 659.229979] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.230224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.230323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.230530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.230719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.230826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.230889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.231132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.231242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.231367] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.333410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.333834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.333915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.334180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.334273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.334370] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a is going to be created. [ 659.376234] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.376448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.376520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.376767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.376978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.390930] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a in Status: UNINITIALIZED for 2s [ 659.711692] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-445 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.713213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-445" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.713213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-445" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.713213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-445" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.713213] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.713213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.713213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.713526] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.713666] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.713787] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.713887] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.713988] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.714119] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.714206] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.714329] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.714533] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.734607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.734724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.734779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.735038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.735153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.735336] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.735429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.735485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.735648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.735741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.735797] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 is going to be updated. [ 659.737888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.738107] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.738193] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.738357] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-445" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.738652] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-825b59c9-e496-42c9-8adc-9f58a092030b taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.738829] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.738978] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.739359] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.739541] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('825b59c9-e496-42c9-8adc-9f58a092030b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.769682] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.769898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.769898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.772936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.772936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.784152] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 in Status: IN_PROGRESS for 2s [ 659.951633] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 659.951633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.242071] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.242317] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.242550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.242943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.243129] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.243328] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 825b59c9-e496-42c9-8adc-9f58a092030b not found, creating... [ 660.243663] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.243866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.244040] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.244324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.244595] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.244870] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.245121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.245280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.245544] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.245718] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.245902] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 825b59c9-e496-42c9-8adc-9f58a092030b is going to be created. [ 660.269121] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.269377] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.269489] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.269791] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.270024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.270329] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.960715] env[66131]: INFO networking_nsxv3.common.synchronization [req-4ff8506d-8567-4691-9669-0281057d7426 req-2a41f9b4-455a-46d4-9222-056591243803 service nova] Enqueued Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_rules [ 660.960987] env[66131]: INFO networking_nsxv3.common.synchronization [req-4ff8506d-8567-4691-9669-0281057d7426 req-2a41f9b4-455a-46d4-9222-056591243803 service nova] Enqueued Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_members [ 660.960987] env[66131]: INFO networking_nsxv3.common.synchronization [req-4ff8506d-8567-4691-9669-0281057d7426 req-2a41f9b4-455a-46d4-9222-056591243803 service nova] Enqueued Resource ID: 825b59c9-e496-42c9-8adc-9f58a092030b with Priority: HIGHEST for action port [ 660.961277] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_rules [ 660.961418] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_members [ 660.961522] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b59c9-e496-42c9-8adc-9f58a092030b with Priority: HIGHEST for action port [ 660.963157] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.963157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.963157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.963157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.963157] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.965734] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.965734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.965734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.965734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.965734] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.966362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.966362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.966552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.967273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.968425] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.968700] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-825b59c9-e496-42c9-8adc-9f58a092030b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.968700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.968700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.968851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.968990] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('825b59c9-e496-42c9-8adc-9f58a092030b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.130031] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c31f00b-ef87-41a5-90f1-2af424685365 req-abbc3f16-99af-4f8f-abaa-1f2abf6ec4db tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: 97a138ed-2484-4683-92fe-8ae6bb27f5e7 with Priority: HIGHEST for action security_group_rules [ 661.130031] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a138ed-2484-4683-92fe-8ae6bb27f5e7 with Priority: HIGHEST for action security_group_rules [ 661.130465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a138ed-2484-4683-92fe-8ae6bb27f5e7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.130648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a138ed-2484-4683-92fe-8ae6bb27f5e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.130692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a138ed-2484-4683-92fe-8ae6bb27f5e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.130954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a138ed-2484-4683-92fe-8ae6bb27f5e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.131092] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a138ed-2484-4683-92fe-8ae6bb27f5e7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.403194] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a in Status: SUCCESS [ 661.403702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.403891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.404150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.404373] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.404508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.404590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.404791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.404871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.404942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.405052] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.581030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581030] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.581030] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 825b59c9-e496-42c9-8adc-9f58a092030b with status ACTIVE [ 661.581030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.581030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.581966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.581966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.581966] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.581966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.582244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.582244] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 825b59c9-e496-42c9-8adc-9f58a092030b is going to be updated. [ 661.606830] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.607020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.607020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.607191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.607340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.607518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-825b59c9-e496-42c9-8adc-9f58a092030b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.657094] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.657425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.657425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.657563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.657681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.657746] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a138ed-2484-4683-92fe-8ae6bb27f5e7 already deleted. [ 661.657838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a138ed-2484-4683-92fe-8ae6bb27f5e7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.681808] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f2bbfdde-85c2-4b4f-a630-398ba22592fb None None] Enqueued Resource ID: e52d487c-9e39-4f7f-a19f-2f84f1d7905b with Priority: HIGHEST for action port [ 661.682521] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e52d487c-9e39-4f7f-a19f-2f84f1d7905b with Priority: HIGHEST for action port [ 661.684392] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e52d487c-9e39-4f7f-a19f-2f84f1d7905b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.684392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e52d487c-9e39-4f7f-a19f-2f84f1d7905b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.684392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e52d487c-9e39-4f7f-a19f-2f84f1d7905b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.684392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e52d487c-9e39-4f7f-a19f-2f84f1d7905b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.684392] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52d487c-9e39-4f7f-a19f-2f84f1d7905b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.796110] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 in Status: SUCCESS [ 661.796304] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 deletion is rescheduled due to dependency. [ 661.796429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.908857] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.909106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.909106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.909323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.909488] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.909584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.909647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.909794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.909881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.909968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.910136] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.910299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.910299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.910412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.910543] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.910641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.910700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.910834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.910908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.910987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.911159] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.963445] env[66131]: INFO networking_nsxv3.common.synchronization [req-ad6cced9-f86f-45ab-bb42-35cacebd047b req-2399d93a-551c-4f9e-b8a6-c82c934238cd tempest-DeleteServersAdminTestJSON-1740667775 tempest-DeleteServersAdminTestJSON-1740667775-project-member] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 661.963886] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 661.964480] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.964821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.964821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.965037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.968474] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.968474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.968474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.968474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.968474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.968474] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.080436] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.186414] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e52d487c-9e39-4f7f-a19f-2f84f1d7905b [ 662.186735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.187011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.187011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.187147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.187194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.187293] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e52d487c-9e39-4f7f-a19f-2f84f1d7905b already deleted. [ 662.187390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e52d487c-9e39-4f7f-a19f-2f84f1d7905b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.408391] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.408391] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.408391] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.408391] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.408867] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.408867] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.409746] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.409746] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.409746] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.410259] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.410452] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.410567] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.410701] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.410822] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.410936] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.411123] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.413729] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a: rpc.has_security_group_logging(os_id): False [ 662.441395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.441612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.441720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.442062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.442247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.442516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.442650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.442717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.442921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.443104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.443307] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.443421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.443508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.443669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.443740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.443964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.444080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.444159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.444336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.444415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.444538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a is going to be created. [ 662.447243] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.447387] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.448013] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.448013] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.448137] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-c9bc6d19-e3d4-4f50-b326-1928ee343427 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.448369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.448369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.449288] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.449548] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9bc6d19-e3d4-4f50-b326-1928ee343427',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.468971] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.469983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.469983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.469983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.469983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.470513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.470513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.470622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.470808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.470808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.470914] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be updated. [ 662.500401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.500609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.500609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.500824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.500965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.513532] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: IN_PROGRESS for 2s [ 662.516044] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.516216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.516344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.516563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.516647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.530158] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a in Status: IN_PROGRESS for 2s [ 662.583455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.583669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.583669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.583856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.583942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.584171] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fc9052-f286-4d53-8d9d-b976649d992e is going to be created. [ 662.621362] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.621362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.621734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.622110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.622494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.633801] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fc9052-f286-4d53-8d9d-b976649d992e in Status: UNINITIALIZED for 2s [ 662.954119] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.954805] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.955270] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.956030] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.956030] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.957456] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port c9bc6d19-e3d4-4f50-b326-1928ee343427 not found, creating... [ 662.957456] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.957456] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.957456] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.957764] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.957764] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.958496] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.958496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.958496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.958496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.959765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.959961] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: c9bc6d19-e3d4-4f50-b326-1928ee343427 is going to be created. [ 662.984691] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.985187] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.985187] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.985381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.985632] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.985867] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.699567] env[66131]: INFO networking_nsxv3.common.synchronization [req-ad6cced9-f86f-45ab-bb42-35cacebd047b req-2c775fca-ab77-4b35-90b6-6d412beb0b1f service nova] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_rules [ 663.699816] env[66131]: INFO networking_nsxv3.common.synchronization [req-ad6cced9-f86f-45ab-bb42-35cacebd047b req-2c775fca-ab77-4b35-90b6-6d412beb0b1f service nova] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 663.699962] env[66131]: INFO networking_nsxv3.common.synchronization [req-ad6cced9-f86f-45ab-bb42-35cacebd047b req-2c775fca-ab77-4b35-90b6-6d412beb0b1f service nova] Enqueued Resource ID: c9bc6d19-e3d4-4f50-b326-1928ee343427 with Priority: HIGHEST for action port [ 663.701288] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_rules [ 663.701466] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 663.701794] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bc6d19-e3d4-4f50-b326-1928ee343427 with Priority: HIGHEST for action port [ 663.701970] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.702132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.702208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.702425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.702500] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.704992] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.705180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.705445] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9bc6d19-e3d4-4f50-b326-1928ee343427 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.705713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.705833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.706082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.706248] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9bc6d19-e3d4-4f50-b326-1928ee343427',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.208749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.208749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.208749] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9bc6d19-e3d4-4f50-b326-1928ee343427 with status ACTIVE [ 664.208749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.208749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.208749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.209333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.209333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.209333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.209333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.209556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.209556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.209629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.209770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.209864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.209924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.210083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.210159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.210243] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9bc6d19-e3d4-4f50-b326-1928ee343427 is going to be updated. [ 664.270265] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.270452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.270521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.270749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.271594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.271594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9bc6d19-e3d4-4f50-b326-1928ee343427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.301529] env[66131]: INFO networking_nsxv3.common.synchronization [None req-a990e32b-0ece-48f4-9680-114ffe40744e None None] Enqueued Resource ID: b6122676-6606-4970-8424-6a5b66707d3c with Priority: HIGHEST for action port [ 664.304649] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6122676-6606-4970-8424-6a5b66707d3c with Priority: HIGHEST for action port [ 664.305708] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6122676-6606-4970-8424-6a5b66707d3c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.305953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6122676-6606-4970-8424-6a5b66707d3c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.306067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6122676-6606-4970-8424-6a5b66707d3c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.306408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6122676-6606-4970-8424-6a5b66707d3c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.306499] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6122676-6606-4970-8424-6a5b66707d3c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.526186] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 664.526186] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf deletion is rescheduled due to dependency. [ 664.526186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.526186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.526186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.526186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.527584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.527584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.527584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.527584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.527584] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.544970] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a in Status: SUCCESS [ 664.544970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.646134] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fc9052-f286-4d53-8d9d-b976649d992e in Status: SUCCESS [ 664.646388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.646486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.646708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.646895] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.647075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.647175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.647346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.647424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.647510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.647598] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.739833] env[66131]: INFO networking_nsxv3.common.synchronization [req-000d0a29-7c66-4082-b142-318590de4568 req-ca2e80cb-4e43-4320-b75e-07a682d7d48f tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_members [ 664.741319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_members [ 664.742261] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.742261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.742261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.742620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.742810] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.742941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.744273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.744273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.744273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.744273] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.809600] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6122676-6606-4970-8424-6a5b66707d3c [ 664.809875] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.810042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.810113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.810314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.810401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.810507] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6122676-6606-4970-8424-6a5b66707d3c already deleted. [ 664.810580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6122676-6606-4970-8424-6a5b66707d3c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.033431] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.151507] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.151740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.151740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.151988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.152235] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.152339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.152420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.152537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.152611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.152720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.152881] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.152976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.153031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.155434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.155434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.155599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.155638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.156241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.157182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.157301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.157482] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.245545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.246066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.246066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.246066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.246329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.246329] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.246511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.246511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.246649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.247059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.247059] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 already deleted. [ 665.247059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.307834] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.308088] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.308088] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.308403] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.308670] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.308880] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.308880] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.312785] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.312988] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.313230] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.313341] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.313456] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.313539] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.313643] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.313742] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.313867] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.332813] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.333035] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.333185] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.333371] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.333621] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-c4d0496a-d3ce-4233-bdc8-954e10947176 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.333792] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.333932] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.334295] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.334440] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d0496a-d3ce-4233-bdc8-954e10947176',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.537621] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.660446] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7fc9052-f286-4d53-8d9d-b976649d992e: rpc.has_security_group_logging(os_id): False [ 665.837610] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.837830] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.837947] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.838251] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.838397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.838544] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port c4d0496a-d3ce-4233-bdc8-954e10947176 not found, creating... [ 665.838799] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.838948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.839096] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.839340] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.839474] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.839743] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.839887] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.839994] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.840842] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.840982] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.841148] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: c4d0496a-d3ce-4233-bdc8-954e10947176 is going to be created. [ 665.860834] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.861050] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.861190] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.861463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.861822] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.862313] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.899239] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.899441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.899488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.899689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.899786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.899986] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.900191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.900191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.900318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.900396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.900586] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.900682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.900742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.901341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.901436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.901634] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.901730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.901793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.901941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.902029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.902278] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7fc9052-f286-4d53-8d9d-b976649d992e is going to be created. [ 665.986958] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.986958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.987160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.987436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.988727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.012331] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fc9052-f286-4d53-8d9d-b976649d992e in Status: IN_PROGRESS for 2s [ 666.040309] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.040309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.040503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.040608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.040699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.040798] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be updated. [ 666.105934] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.105934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.105934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.105934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.105934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.119981] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: IN_PROGRESS for 2s [ 666.635127] env[66131]: INFO networking_nsxv3.common.synchronization [req-000d0a29-7c66-4082-b142-318590de4568 req-e444cfc5-1bd8-4bc2-8837-e7614e3cfb8d service nova] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_rules [ 666.635469] env[66131]: INFO networking_nsxv3.common.synchronization [req-000d0a29-7c66-4082-b142-318590de4568 req-e444cfc5-1bd8-4bc2-8837-e7614e3cfb8d service nova] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_members [ 666.635469] env[66131]: INFO networking_nsxv3.common.synchronization [req-000d0a29-7c66-4082-b142-318590de4568 req-e444cfc5-1bd8-4bc2-8837-e7614e3cfb8d service nova] Enqueued Resource ID: c4d0496a-d3ce-4233-bdc8-954e10947176 with Priority: HIGHEST for action port [ 666.637664] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_rules [ 666.640997] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_members [ 666.641342] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d0496a-d3ce-4233-bdc8-954e10947176 with Priority: HIGHEST for action port [ 666.641774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.642628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.642628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.642628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.642628] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.643775] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.643955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.648356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.648356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.648356] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.648356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.648356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.648678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.648678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.648678] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.650641] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d0496a-d3ce-4233-bdc8-954e10947176 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.650834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.655048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.655048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.655373] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d0496a-d3ce-4233-bdc8-954e10947176',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.159803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.159978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.160160] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.161098] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4d0496a-d3ce-4233-bdc8-954e10947176 with status ACTIVE [ 667.161326] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.161441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.161507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.161719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.161806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.161975] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.162084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.162145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.162326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.162396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.162581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.162690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.162751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.162891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.162964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.164304] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4d0496a-d3ce-4233-bdc8-954e10947176 is going to be updated. [ 667.188346] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.188551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.188661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.189374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.189374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.189374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d0496a-d3ce-4233-bdc8-954e10947176" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.667905] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.027498] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7fc9052-f286-4d53-8d9d-b976649d992e in Status: SUCCESS [ 668.027613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.133900] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 668.133900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.134064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.134252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.134469] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.134555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.134594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.134742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.134803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.134921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.135071] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.170318] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.171123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.171123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.171123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.171408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.171443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 is going to be created. [ 668.206772] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.206772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.206772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.206772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.206772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.218241] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: UNINITIALIZED for 2s [ 668.638531] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.638702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.638756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.638975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.639175] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.639279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.639342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.639494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.639585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.639673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.639843] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.639918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.639955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.640105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.640236] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.640345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.640452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.640612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.640726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.641014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.641014] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.144067] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c5da787-634a-44a5-9a16-ff46306549cf: rpc.has_security_group_logging(os_id): False [ 669.162471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.162839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.162925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.163166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.163258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.163460] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.163572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.163623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.163823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.164115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.165508] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.165706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.165863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.166044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.166126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.166352] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.167050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.167050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.167050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.167050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.167050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be updated. [ 669.244795] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.244795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.244795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.244990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.244990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.261089] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: IN_PROGRESS for 2s [ 669.691237] env[66131]: INFO networking_nsxv3.common.synchronization [req-35f0d452-f49f-49b2-b6eb-9a7b38ea7898 req-f88a909a-96c4-4af8-b959-0f3d25f533e2 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 669.691687] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 669.692170] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.692323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.692396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.692608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.692764] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.692860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.692923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.693079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.693165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.693260] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.195848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.196212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.196212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.196429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.199051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.199051] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.199051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.199051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.199051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.199051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.199051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 670.227704] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.228065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.228238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.228611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.228868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.231722] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: UNINITIALIZED for 4s [ 670.239486] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 670.295246] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.295461] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.295586] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.295852] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.296120] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.296665] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.296665] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.296665] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.296820] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.296918] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.297038] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.297163] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.297267] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.297388] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.297491] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.297615] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.324089] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.324274] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.324354] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.324527] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.324852] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-a82beb50-0803-4eaf-b6f7-afc880d73fbf taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.325110] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.325313] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.325696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.325829] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82beb50-0803-4eaf-b6f7-afc880d73fbf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.828542] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.828901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.829136] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.829542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.829781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.830045] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port a82beb50-0803-4eaf-b6f7-afc880d73fbf not found, creating... [ 670.830475] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.830733] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.830917] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.831977] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.832241] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.833091] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.833555] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.833847] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.834199] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.834431] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.835156] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: a82beb50-0803-4eaf-b6f7-afc880d73fbf is going to be created. [ 670.857445] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.857677] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.858156] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.858156] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.858322] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.858589] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.321739] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 671.322950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.654798] env[66131]: INFO networking_nsxv3.common.synchronization [req-35f0d452-f49f-49b2-b6eb-9a7b38ea7898 req-02f46a01-facf-4408-a02b-cf2e95504855 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 671.654798] env[66131]: INFO networking_nsxv3.common.synchronization [req-35f0d452-f49f-49b2-b6eb-9a7b38ea7898 req-02f46a01-facf-4408-a02b-cf2e95504855 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 671.654798] env[66131]: INFO networking_nsxv3.common.synchronization [req-35f0d452-f49f-49b2-b6eb-9a7b38ea7898 req-02f46a01-facf-4408-a02b-cf2e95504855 service nova] Enqueued Resource ID: a82beb50-0803-4eaf-b6f7-afc880d73fbf with Priority: HIGHEST for action port [ 671.655068] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 671.655605] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 671.655605] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a82beb50-0803-4eaf-b6f7-afc880d73fbf with Priority: HIGHEST for action port [ 671.655605] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.655785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.655785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.655980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.658194] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.659545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.659660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.659845] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a82beb50-0803-4eaf-b6f7-afc880d73fbf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.659944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.660024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.660343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.660343] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82beb50-0803-4eaf-b6f7-afc880d73fbf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.737935] env[66131]: INFO networking_nsxv3.common.synchronization [req-50dd0569-b2ae-4b40-9c83-ecfd0a780d80 req-d031a5f8-58d6-4ae3-a6bd-c8b787aefcf7 tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 with Priority: HIGHEST for action security_group_rules [ 671.738496] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 with Priority: HIGHEST for action security_group_rules [ 671.738802] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.738922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.738990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.739704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.739797] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b97bedc6-3664-476d-9ca7-2cb6bf9acf87',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.877328] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ccb0db8f-8410-425e-a18a-4631dfefaacd None None] Enqueued Resource ID: ffeb98b0-4815-4383-903a-aa65d07d3508 with Priority: HIGHEST for action port [ 671.877826] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffeb98b0-4815-4383-903a-aa65d07d3508 with Priority: HIGHEST for action port [ 671.878716] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffeb98b0-4815-4383-903a-aa65d07d3508 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.878716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffeb98b0-4815-4383-903a-aa65d07d3508" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.878716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffeb98b0-4815-4383-903a-aa65d07d3508" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.879231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffeb98b0-4815-4383-903a-aa65d07d3508" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.879231] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffeb98b0-4815-4383-903a-aa65d07d3508',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.163937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.164177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.164270] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a82beb50-0803-4eaf-b6f7-afc880d73fbf with status ACTIVE [ 672.164472] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.164678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.164678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.164926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.165012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.165796] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.165796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.165796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.165796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.165796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.165796] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.166164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.166164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.166164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.166164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.166431] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a82beb50-0803-4eaf-b6f7-afc880d73fbf is going to be updated. [ 672.191383] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.191555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.191620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.191809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.191947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.192128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a82beb50-0803-4eaf-b6f7-afc880d73fbf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.241893] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: SUCCESS [ 672.242250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.243266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.243461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.243650] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.243759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.243814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.243962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.244047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.244131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.244217] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.254368] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 672.254579] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 672.254672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.254791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.255358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.255728] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.255728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.255859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.255951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.256125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.256188] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.288599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.288857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.288857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.289077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.289231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.289384] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 already deleted. [ 672.289739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.382519] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffeb98b0-4815-4383-903a-aa65d07d3508 [ 672.382826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.382896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.382937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.384044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.384044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.384044] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffeb98b0-4815-4383-903a-aa65d07d3508 already deleted. [ 672.384044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffeb98b0-4815-4383-903a-aa65d07d3508" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.748987] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.759377] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.254023] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40da76d9-e82a-4df1-a543-dfbd1d154789: rpc.has_security_group_logging(os_id): False [ 673.263373] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.270647] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.271648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.271648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.271648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.271648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.271648] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.271648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.271648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.271995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.271995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.271995] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 is going to be created. [ 673.342671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.345020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.345020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.345020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.345020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.357063] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: IN_PROGRESS for 2s [ 673.767736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.767736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.767736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.767736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.767736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.768286] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 673.822671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.822995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.822995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.823217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.823294] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.834590] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 674.208050] env[66131]: INFO networking_nsxv3.common.synchronization [None req-93a6c0e1-8799-461c-b11f-3d7b150db993 None None] Enqueued Resource ID: aac109d7-a7fc-49c4-af0d-b32e7aeae415 with Priority: HIGHEST for action port [ 674.208569] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac109d7-a7fc-49c4-af0d-b32e7aeae415 with Priority: HIGHEST for action port [ 674.208935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac109d7-a7fc-49c4-af0d-b32e7aeae415 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.209118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac109d7-a7fc-49c4-af0d-b32e7aeae415" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.209187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac109d7-a7fc-49c4-af0d-b32e7aeae415" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.209568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac109d7-a7fc-49c4-af0d-b32e7aeae415" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.209840] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac109d7-a7fc-49c4-af0d-b32e7aeae415',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.379874] env[66131]: INFO networking_nsxv3.common.synchronization [req-ea167272-c4ce-41fa-898c-bdd531ffe13c req-5c996f65-858b-4b5f-b924-25cc1833dc57 tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 with Priority: HIGHEST for action security_group_rules [ 674.380859] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 with Priority: HIGHEST for action security_group_rules [ 674.382938] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.382938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.382938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.382938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.382938] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b97bedc6-3664-476d-9ca7-2cb6bf9acf87',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.712713] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aac109d7-a7fc-49c4-af0d-b32e7aeae415 [ 674.712713] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.712713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.712713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.712893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.712983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.713361] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aac109d7-a7fc-49c4-af0d-b32e7aeae415 already deleted. [ 674.713479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac109d7-a7fc-49c4-af0d-b32e7aeae415" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.903564] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.903928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.903928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.904050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.904092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.904193] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 already deleted. [ 674.904271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.372867] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: SUCCESS [ 675.373207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.845940] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 675.846175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.846383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.846685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.847071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.847071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.847265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.847265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.847329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.847456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.847565] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.350786] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.350786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.350786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.351094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.351094] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.351421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.351421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.351421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.351550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.351583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.352172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.352172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.352172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.352172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.352172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.352562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.352562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.352562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.352562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.352849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.352849] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.570586] env[66131]: INFO networking_nsxv3.common.synchronization [req-0f295106-e31a-4943-981c-04c08119bd94 req-a8532f0e-ee4e-4360-8ac6-c1fb15502172 tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 676.571447] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 676.571846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.571941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.571941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.572701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.572701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.572701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.572701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.572701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.572701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.572966] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.857607] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6518e255-8a48-4fe6-8c80-b478b31e143a: rpc.has_security_group_logging(os_id): False [ 676.889739] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.890078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.890078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.890372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.890372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.890579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.890836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.890836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.891023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.891023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.891374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.891374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.891374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.891554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.891554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.891749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.891951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.891951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.892060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.892129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.892206] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 676.987992] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.988250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.988250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.988400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.988548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.003395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 677.031613] env[66131]: INFO networking_nsxv3.common.synchronization [req-a93689fe-7f7e-4192-82b8-60776732d095 req-8331ae6f-be71-4e4b-b25f-c819a7552391 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 677.031613] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 677.031815] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.031965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.032682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.032928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.033119] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.033240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.033304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.033481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.033593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.033700] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.041013] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.041013] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.041272] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.041428] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.041600] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.041765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.041928] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.043343] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.043571] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.043829] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.043936] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.044054] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.044161] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.044266] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.044367] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.044487] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.068931] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.069234] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.069720] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.069720] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.069932] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-0a95241d-4cef-4183-b256-264d7960cf74 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.070123] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.070249] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.070613] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.070934] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a95241d-4cef-4183-b256-264d7960cf74',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.074961] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.539374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.539653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.539653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.539800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.539890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.540090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.540185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.540241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.540460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.540559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.540672] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 677.569053] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.569304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.569399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.569626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.569777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.575195] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.575409] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.575750] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.575836] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.575974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.576232] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 0a95241d-4cef-4183-b256-264d7960cf74 not found, creating... [ 677.576557] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.576819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.576891] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.577095] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.577200] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.577562] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.577721] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.577829] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.578083] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.578314] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.578397] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 0a95241d-4cef-4183-b256-264d7960cf74 is going to be created. [ 677.579620] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.587945] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 677.597919] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.598127] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.598240] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.598496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.598710] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.598919] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.082982] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.083201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.083291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.083491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.083606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.083703] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 678.119816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.120395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.120395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.120561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.120885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.137167] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 678.443393] env[66131]: INFO networking_nsxv3.common.synchronization [req-0f295106-e31a-4943-981c-04c08119bd94 req-6013b2f3-9b52-4555-a2de-f4e015de8fba service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 678.443577] env[66131]: INFO networking_nsxv3.common.synchronization [req-0f295106-e31a-4943-981c-04c08119bd94 req-6013b2f3-9b52-4555-a2de-f4e015de8fba service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 678.443770] env[66131]: INFO networking_nsxv3.common.synchronization [req-0f295106-e31a-4943-981c-04c08119bd94 req-6013b2f3-9b52-4555-a2de-f4e015de8fba service nova] Enqueued Resource ID: 0a95241d-4cef-4183-b256-264d7960cf74 with Priority: HIGHEST for action port [ 678.444531] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 678.444720] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 678.444720] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a95241d-4cef-4183-b256-264d7960cf74 with Priority: HIGHEST for action port [ 678.449636] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.449636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.449636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.450439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.450439] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.452681] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.452821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.457868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a95241d-4cef-4183-b256-264d7960cf74 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.458150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.458150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.459438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.459550] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a95241d-4cef-4183-b256-264d7960cf74',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.961925] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.962324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.962324] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a95241d-4cef-4183-b256-264d7960cf74 with status ACTIVE [ 678.962494] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.962634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.962721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.962986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.963183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.963434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.963572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.963678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.963892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.963998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.964251] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.964484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.964484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.964638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.964738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.964848] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a95241d-4cef-4183-b256-264d7960cf74 is going to be updated. [ 678.989370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.990143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.990279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.990576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.990792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.991029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a95241d-4cef-4183-b256-264d7960cf74" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.017486] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 679.017804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.601152] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 679.601463] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 679.601608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.150571] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 680.151523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.151523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.151523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.151523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.151724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.151724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.151858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.151913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.152027] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.463903] env[66131]: INFO networking_nsxv3.common.synchronization [req-5b1f9f53-2abf-4383-bd39-4b498e44538a req-c6b6b1c9-6ba4-4f63-a773-a397c28b0e3c tempest-SecurityGroupRulesTestJSON-2020916103 tempest-SecurityGroupRulesTestJSON-2020916103-project-member] Enqueued Resource ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 with Priority: HIGHEST for action security_group_rules [ 680.463903] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 with Priority: HIGHEST for action security_group_rules [ 680.463903] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.463903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.463903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.463903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.463903] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b97bedc6-3664-476d-9ca7-2cb6bf9acf87',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.655955] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.990484] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.990900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.990900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.990900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.991199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.991199] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b97bedc6-3664-476d-9ca7-2cb6bf9acf87 already deleted. [ 680.991199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b97bedc6-3664-476d-9ca7-2cb6bf9acf87" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.162522] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.666257] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.666468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.666567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.666845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.666973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.667117] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 681.716667] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.716867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.716975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.717299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.717520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.733602] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 682.517303] env[66131]: INFO networking_nsxv3.common.synchronization [req-32442651-cb1f-4651-83f9-f6c9794ec16d req-b8168edf-e643-4c98-9957-63fe301f8193 tempest-AttachInterfacesV270Test-804379305 tempest-AttachInterfacesV270Test-804379305-project-member] Enqueued Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_members [ 682.518140] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a with Priority: HIGHEST for action security_group_members [ 682.519847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.519847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.519847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.519847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.520044] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.520093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.520129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.520286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.520372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.520466] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.025097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.025097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.025097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.025097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.025097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.025097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.025097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.025097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.025395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.025395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.025395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a is going to be updated. [ 683.055185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.055321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.055359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.055601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.055739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.066337] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a in Status: IN_PROGRESS for 2s [ 683.137709] env[66131]: INFO networking_nsxv3.common.synchronization [req-fb7a6159-346b-4576-9a4f-ccae451aa398 req-dca11eeb-0b16-4a52-8fd3-42c1e1797c8d tempest-DeleteServersAdminTestJSON-1740667775 tempest-DeleteServersAdminTestJSON-1740667775-project-member] Enqueued Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 683.138543] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5da787-634a-44a5-9a16-ff46306549cf with Priority: HIGHEST for action security_group_members [ 683.139268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5da787-634a-44a5-9a16-ff46306549cf taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.139674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.139674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.140213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.140394] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.140516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.141516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.141859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.141859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.141937] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5da787-634a-44a5-9a16-ff46306549cf',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.647271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.647959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.647959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.647959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.648526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.648774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.648894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.648966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.649346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.649648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.649648] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf is going to be updated. [ 683.689531] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.689704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.689762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.690020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.690214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.703818] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: IN_PROGRESS for 2s [ 683.750403] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 683.750634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.750868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.751120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.751344] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.751487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.751560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.751728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.751807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.751897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.751989] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.006519] env[66131]: INFO networking_nsxv3.common.synchronization [req-62233548-96d4-4f6f-b527-504a1f7a8d72 req-efba1a6d-ead6-4282-855b-96f487575053 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 684.006641] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 684.006903] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.006976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.007034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.007307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.007491] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.007615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.007713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.007957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.008061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.008155] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.255609] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.255773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.255849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.256406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.256406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.256576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.256576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.256638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.256771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.256809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.257357] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.257474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.257530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.257679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.257822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.257914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.258262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.258262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.258262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.258262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.258398] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.430091] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.430091] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.430091] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.430342] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.430404] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.430567] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.430675] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.430884] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.431029] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.431230] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.431388] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.431569] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.431747] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.431954] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.432021] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.432148] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.456394] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.456708] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.457437] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.457437] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.457437] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.457592] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.457662] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.458245] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.458245] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66bdfa9e-3e0a-48eb-ba63-da19b48e798e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.510622] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.510766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.510839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.513129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.513129] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a already deleted. [ 684.513129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.761806] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e016bdc-1186-4d65-a6a4-b589ea567689: rpc.has_security_group_logging(os_id): False [ 684.784906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.785141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.785251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.785753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.785833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.786205] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.787306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.787306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.787306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.787306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.787647] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.787822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.787938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.789404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.789584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.790818] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.791109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.791263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.791532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.792318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.792500] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 684.888508] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.888508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.888508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.888751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.888819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.909730] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 684.960522] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.960867] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.961032] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.961374] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.961552] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.961813] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 66bdfa9e-3e0a-48eb-ba63-da19b48e798e not found, creating... [ 684.962074] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.962253] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.962323] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.962557] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.962903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.963023] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.963187] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.963328] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.963506] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.963860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.963860] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e is going to be created. [ 685.002774] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.003243] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.003421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.003908] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.004341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.004750] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.079557] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a in Status: SUCCESS [ 685.079777] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a deletion is rescheduled due to dependency. [ 685.079913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.691794] env[66131]: INFO networking_nsxv3.common.synchronization [req-62233548-96d4-4f6f-b527-504a1f7a8d72 req-99808ebf-7e1b-4671-9f4a-2e64c9fa7c8c service nova] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 685.692063] env[66131]: INFO networking_nsxv3.common.synchronization [req-62233548-96d4-4f6f-b527-504a1f7a8d72 req-99808ebf-7e1b-4671-9f4a-2e64c9fa7c8c service nova] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 685.692117] env[66131]: INFO networking_nsxv3.common.synchronization [req-62233548-96d4-4f6f-b527-504a1f7a8d72 req-99808ebf-7e1b-4671-9f4a-2e64c9fa7c8c service nova] Enqueued Resource ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with Priority: HIGHEST for action port [ 685.692632] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 685.692770] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 685.692868] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with Priority: HIGHEST for action port [ 685.693626] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.693814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.693942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.694383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.694549] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.695862] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.696035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.696109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.696313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.696496] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.696615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.696698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.696867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.696993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.697178] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.698015] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.698473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.698473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.698473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.698473] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66bdfa9e-3e0a-48eb-ba63-da19b48e798e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.714444] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5da787-634a-44a5-9a16-ff46306549cf in Status: SUCCESS [ 685.714615] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5da787-634a-44a5-9a16-ff46306549cf deletion is rescheduled due to dependency. [ 685.714894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5da787-634a-44a5-9a16-ff46306549cf" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.203061] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.203061] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.203061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.203061] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d571761-cb87-46db-9624-7462c30b8c8c req-67ee48dd-74e6-4bc4-8b26-2f79ccf70f72 tempest-FloatingIPsAssociationTestJSON-1405363732 tempest-FloatingIPsAssociationTestJSON-1405363732-project-member] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 686.203443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with status ACTIVE [ 686.203799] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.203799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.203799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.204061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.204196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.204412] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.204580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.204678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.204878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.205012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.205243] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.205386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.205485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.205682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.205779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.205900] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e is going to be updated. [ 686.207397] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 686.207748] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.207913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.208027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.208218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.208407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.208548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.208645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.208820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.208940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.209076] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.232994] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.233176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.233251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.235326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.235551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.237411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.614015] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.614015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.614015] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.618977] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.618977] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.618977] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.618977] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.618977] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.618977] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.618977] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.618977] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.618977] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.637875] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.637875] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.637875] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.639017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-225" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.639017] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.639319] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.639557] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.639990] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.640250] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a683086b-9ad9-40dd-bcda-5b9ac193e8d2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.708410] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.712770] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.949654] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 686.949913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.144839] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.144839] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.144839] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.144839] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.144839] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.144839] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port a683086b-9ad9-40dd-bcda-5b9ac193e8d2 not found, creating... [ 687.145185] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.145185] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.145276] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.145555] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.145759] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.146156] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.146352] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.146559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.146831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.147013] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.147204] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: a683086b-9ad9-40dd-bcda-5b9ac193e8d2 is going to be created. [ 687.171845] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.172077] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.172177] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.172493] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.172723] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.172955] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.210987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.211428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.211428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.211428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.211541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.211659] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be created. [ 687.215442] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.240447] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.240785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.240785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.240917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.241061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.263074] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: UNINITIALIZED for 2s [ 687.718051] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.718164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.718164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.718476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.718603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.718727] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be updated. [ 687.749064] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.749234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.749325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.749538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.749683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.760348] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: IN_PROGRESS for 2s [ 687.929821] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d571761-cb87-46db-9624-7462c30b8c8c req-a6e5c8df-e2ba-4ebc-be72-0999a3b67267 service nova] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_rules [ 687.929993] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d571761-cb87-46db-9624-7462c30b8c8c req-a6e5c8df-e2ba-4ebc-be72-0999a3b67267 service nova] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 687.930135] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d571761-cb87-46db-9624-7462c30b8c8c req-a6e5c8df-e2ba-4ebc-be72-0999a3b67267 service nova] Enqueued Resource ID: a683086b-9ad9-40dd-bcda-5b9ac193e8d2 with Priority: HIGHEST for action port [ 687.930392] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_rules [ 687.930822] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 687.930822] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a683086b-9ad9-40dd-bcda-5b9ac193e8d2 with Priority: HIGHEST for action port [ 687.931756] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.932109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.932250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.932630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.932763] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.934088] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.934193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.934424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.934658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.934911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.935358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.936082] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a683086b-9ad9-40dd-bcda-5b9ac193e8d2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.438153] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.439227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.439227] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a683086b-9ad9-40dd-bcda-5b9ac193e8d2 with status ACTIVE [ 688.439227] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.439227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.439500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.439500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.439631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.439852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.439986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.440084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.440273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.440674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.441046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.441046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.441129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.441224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.442167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.442167] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a683086b-9ad9-40dd-bcda-5b9ac193e8d2 is going to be updated. [ 688.468556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.468718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.468791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.469014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.469149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.469856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a683086b-9ad9-40dd-bcda-5b9ac193e8d2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.134675] env[66131]: INFO networking_nsxv3.common.synchronization [None req-8dbc23a3-e3a1-4a8f-9931-d1c45ac2e9f3 tempest-MigrationsAdminTest-1398354370 tempest-MigrationsAdminTest-1398354370-project-member] Enqueued Resource ID: c1e3ef25-e74b-46c0-90f8-35321507b640 with Priority: HIGHEST for action security_group_rules [ 689.135307] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e3ef25-e74b-46c0-90f8-35321507b640 with Priority: HIGHEST for action security_group_rules [ 689.135687] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e3ef25-e74b-46c0-90f8-35321507b640 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.135835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.135925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.136449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.136449] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e3ef25-e74b-46c0-90f8-35321507b640',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.273830] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.273830] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.273830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.273830] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.660505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.660854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.660854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.661054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.661181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.661398] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e3ef25-e74b-46c0-90f8-35321507b640 already deleted. [ 689.662095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.681732] env[66131]: INFO networking_nsxv3.common.synchronization [None req-9780c1b9-697a-4ebe-8c22-2b3521c13c9e tempest-MigrationsAdminTest-1398354370 tempest-MigrationsAdminTest-1398354370-project-member] Enqueued Resource ID: c1e3ef25-e74b-46c0-90f8-35321507b640 with Priority: HIGHEST for action security_group_rules [ 689.682651] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e3ef25-e74b-46c0-90f8-35321507b640 with Priority: HIGHEST for action security_group_rules [ 689.682732] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e3ef25-e74b-46c0-90f8-35321507b640 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.682925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.683007] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.683300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.683638] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e3ef25-e74b-46c0-90f8-35321507b640',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.772025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 689.772025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.772223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.772295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.772847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.772847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.772847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.772973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.772973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.773043] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.775673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.778046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.778046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.778046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.778046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.778591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.778591] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.205595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.205789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.205838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.206071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.206211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.206272] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e3ef25-e74b-46c0-90f8-35321507b640 already deleted. [ 690.206375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e3ef25-e74b-46c0-90f8-35321507b640" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.280792] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.284792] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 690.306376] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.306376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.306376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.307282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.307282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.307282] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.307282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.307454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.307569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.307611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.307880] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.308541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.308541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.308852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.308986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.309478] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.309478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.309478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.309630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.309712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.309849] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be created. [ 690.375434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.375601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.375648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.376231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.376231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.388477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 690.787099] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.228267] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c4e5dc3-1fa0-479f-be81-188662d36c76 req-8f571cd9-ef18-44e1-928a-afb538ad2909 tempest-ServersAdminNegativeTestJSON-1386696782 tempest-ServersAdminNegativeTestJSON-1386696782-project-member] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 691.228861] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 691.229305] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.229451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.230807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.230807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.230807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.230807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.230807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.230807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.230807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.230807] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.289971] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.290302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.290302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.290463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.290837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.290837] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be updated. [ 691.328450] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.328610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.328674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.328898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.329055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.339648] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: IN_PROGRESS for 2s [ 691.534466] env[66131]: INFO networking_nsxv3.common.synchronization [req-5ee63e33-e362-4601-89d6-dd4e0d25dd33 req-f73c62ff-a7e8-4fed-bf85-b360eada2b59 tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 691.535431] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 691.535703] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.535891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.536013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.536311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.536559] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.536737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.536854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.537137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.537300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.537847] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.734466] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.942908] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.943245] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.943245] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.943841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.943841] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.943841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.944214] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.944214] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.944296] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.944737] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.944737] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.944737] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.944877] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.944990] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.945382] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.945382] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.968631] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.968631] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.968631] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.968631] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.968631] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-7d8ceac1-25d3-4730-8a41-2a9e7856165f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.968631] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.968631] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.968631] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.968631] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d8ceac1-25d3-4730-8a41-2a9e7856165f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.043455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.043618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.044238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.044518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.044629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.044846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.044980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.045033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.045542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.045640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.045738] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 692.074478] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.074620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.074690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.074901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.075054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.084826] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 692.240329] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.266371] env[66131]: INFO networking_nsxv3.common.synchronization [None req-54bf8488-ef3d-40ee-a0cd-9d1a81869799 None None] Enqueued Resource ID: c412da5c-8356-4675-b21a-ef3b3b78d8ee with Priority: HIGHEST for action port [ 692.266961] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c412da5c-8356-4675-b21a-ef3b3b78d8ee with Priority: HIGHEST for action port [ 692.268042] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c412da5c-8356-4675-b21a-ef3b3b78d8ee taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.268042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c412da5c-8356-4675-b21a-ef3b3b78d8ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.268042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c412da5c-8356-4675-b21a-ef3b3b78d8ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.268042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c412da5c-8356-4675-b21a-ef3b3b78d8ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.268042] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c412da5c-8356-4675-b21a-ef3b3b78d8ee',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.406137] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 692.406137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.472319] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.472545] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.472751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.473104] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.473259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.473429] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 7d8ceac1-25d3-4730-8a41-2a9e7856165f not found, creating... [ 692.473772] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.473944] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.474069] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.474573] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.474573] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.474717] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.474944] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.475181] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.475459] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.475597] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.475746] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 7d8ceac1-25d3-4730-8a41-2a9e7856165f is going to be created. [ 692.496292] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.496292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.496528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.496681] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.496922] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.497301] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.741720] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.741888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.741963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.742202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.742297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.742395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be updated. [ 692.769430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.769586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.769660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.769891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.770030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.771085] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c412da5c-8356-4675-b21a-ef3b3b78d8ee [ 692.771258] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.771383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.771452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.771616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.771700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.771789] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c412da5c-8356-4675-b21a-ef3b3b78d8ee already deleted. [ 692.771874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c412da5c-8356-4675-b21a-ef3b3b78d8ee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.781354] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: IN_PROGRESS for 2s [ 693.272153] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c4e5dc3-1fa0-479f-be81-188662d36c76 req-62b736c3-3f01-4965-bdee-2a2fc62bc419 service nova] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_rules [ 693.272461] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c4e5dc3-1fa0-479f-be81-188662d36c76 req-62b736c3-3f01-4965-bdee-2a2fc62bc419 service nova] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 693.272587] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c4e5dc3-1fa0-479f-be81-188662d36c76 req-62b736c3-3f01-4965-bdee-2a2fc62bc419 service nova] Enqueued Resource ID: 7d8ceac1-25d3-4730-8a41-2a9e7856165f with Priority: HIGHEST for action port [ 693.274797] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_rules [ 693.274970] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 693.275078] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d8ceac1-25d3-4730-8a41-2a9e7856165f with Priority: HIGHEST for action port [ 693.275344] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.275466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.275540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.275738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.275819] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.276884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.276941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.277430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d8ceac1-25d3-4730-8a41-2a9e7856165f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.277539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.277632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.277788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.277861] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d8ceac1-25d3-4730-8a41-2a9e7856165f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.351368] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 693.351587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.351792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.352018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.352224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.352411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.352468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.352652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.352739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.352830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.352925] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.781515] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.781671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.781851] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d8ceac1-25d3-4730-8a41-2a9e7856165f with status ACTIVE [ 693.782035] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.782142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.782210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.782456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.782586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.782932] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.783033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.783135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.783426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.783572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.783880] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.784014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.784708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.784957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.785097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.785236] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d8ceac1-25d3-4730-8a41-2a9e7856165f is going to be updated. [ 693.812930] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.814748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.814919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.815182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.815334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.815510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d8ceac1-25d3-4730-8a41-2a9e7856165f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.855952] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.856140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.856264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.856570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.856570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.856779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.856779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.856875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.856926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.857034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.857186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.857288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.857376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.857574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.857666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.857745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.857745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.857861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.858169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.858282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.858412] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.097219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 694.097526] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 deletion is rescheduled due to dependency. [ 694.097731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.362499] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5c2151-bad2-47ce-a462-d37d0b06e5f6: rpc.has_security_group_logging(os_id): False [ 694.385506] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.385681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.385755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.386015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.386520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.386777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.387180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.387180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.387294] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.387462] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.387588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.387651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.388136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.388767] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.388929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.389029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.389192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.389390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.389497] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be updated. [ 694.508163] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.508732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.508732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.508732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.509253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.529979] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: IN_PROGRESS for 2s [ 694.762894] env[66131]: INFO networking_nsxv3.common.synchronization [None req-fa1506ff-7b51-4f2f-9b66-3c48e9309aea None None] Enqueued Resource ID: ec37a6d2-a241-4a1d-915c-7ea52e7c787e with Priority: HIGHEST for action port [ 694.763692] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec37a6d2-a241-4a1d-915c-7ea52e7c787e with Priority: HIGHEST for action port [ 694.763788] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec37a6d2-a241-4a1d-915c-7ea52e7c787e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.763900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec37a6d2-a241-4a1d-915c-7ea52e7c787e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.763963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec37a6d2-a241-4a1d-915c-7ea52e7c787e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.765061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec37a6d2-a241-4a1d-915c-7ea52e7c787e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.765061] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec37a6d2-a241-4a1d-915c-7ea52e7c787e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.793478] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 694.794501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.796615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.796615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.796615] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.796615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.796615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.796615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.796615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.796615] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.270874] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec37a6d2-a241-4a1d-915c-7ea52e7c787e [ 695.271131] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.271263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.271469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.271670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.271670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.271775] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec37a6d2-a241-4a1d-915c-7ea52e7c787e already deleted. [ 695.271895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec37a6d2-a241-4a1d-915c-7ea52e7c787e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.301518] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.304216] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f506e0c7-8ee0-41f0-88db-63eabb4b0430 None None] Enqueued Resource ID: dcf7dee5-c3dd-4529-8521-5b7f50c7446a with Priority: HIGHEST for action port [ 695.305398] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf7dee5-c3dd-4529-8521-5b7f50c7446a with Priority: HIGHEST for action port [ 695.306092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcf7dee5-c3dd-4529-8521-5b7f50c7446a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.306168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcf7dee5-c3dd-4529-8521-5b7f50c7446a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.307043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcf7dee5-c3dd-4529-8521-5b7f50c7446a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.307137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcf7dee5-c3dd-4529-8521-5b7f50c7446a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.307483] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcf7dee5-c3dd-4529-8521-5b7f50c7446a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.808071] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.812844] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcf7dee5-c3dd-4529-8521-5b7f50c7446a [ 695.812844] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.812844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.812844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.812844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.812844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.812844] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcf7dee5-c3dd-4529-8521-5b7f50c7446a already deleted. [ 695.813408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcf7dee5-c3dd-4529-8521-5b7f50c7446a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.312330] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.312623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.312726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.313028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.313223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.313376] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be updated. [ 696.351859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.352064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.352115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.352308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.352461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.363549] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: IN_PROGRESS for 2s [ 696.548626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 696.548626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.431768] env[66131]: INFO networking_nsxv3.common.synchronization [None req-edeb288c-8fb2-4fc9-844b-ca118a0c3f8a None None] Enqueued Resource ID: 79b112dd-b32d-490b-8f38-5d3d1b35bd1b with Priority: HIGHEST for action port [ 697.431768] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79b112dd-b32d-490b-8f38-5d3d1b35bd1b with Priority: HIGHEST for action port [ 697.432437] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-79b112dd-b32d-490b-8f38-5d3d1b35bd1b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.432437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79b112dd-b32d-490b-8f38-5d3d1b35bd1b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.432437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79b112dd-b32d-490b-8f38-5d3d1b35bd1b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.432575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79b112dd-b32d-490b-8f38-5d3d1b35bd1b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.432661] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79b112dd-b32d-490b-8f38-5d3d1b35bd1b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.935443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79b112dd-b32d-490b-8f38-5d3d1b35bd1b [ 697.935443] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.935594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.935670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.936318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.936318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.936318] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79b112dd-b32d-490b-8f38-5d3d1b35bd1b already deleted. [ 697.936318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79b112dd-b32d-490b-8f38-5d3d1b35bd1b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.376750] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 698.377727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.377727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.377727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.377949] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.378099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.378197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.378411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.379231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.380319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.380319] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.435035] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c8736b9-cd19-47ba-98e2-ea5fb6c124ae req-c307bf3c-48a2-467a-96e0-1ce544212cfc tempest-ImagesOneServerTestJSON-1015075785 tempest-ImagesOneServerTestJSON-1015075785-project-member] Enqueued Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_members [ 698.435584] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_members [ 698.436591] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.436591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.436769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.436926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.437101] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.437203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.437256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.437405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.437487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.437584] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.883209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.883476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.883573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.883793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.884043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.884180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.885459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.885707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.885853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.885958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.886459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.886687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.886745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.886903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.887094] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.887198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.887293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.887454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.887540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.887904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.887904] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.941098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.941335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.941428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.941803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.941803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.942026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.942132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.942195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.942500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.942500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.942628] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d already deleted. [ 698.942684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.204879] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.204879] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.205130] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.205424] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.205732] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.205961] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.206264] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.206636] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.206858] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.207121] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.207308] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.207492] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.207611] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.207732] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.207845] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.208623] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.234205] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.234422] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.234563] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.234895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.235307] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-8675189d-ecb5-4636-b94c-71a936298ff1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.235541] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.235694] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.236247] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.236462] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8675189d-ecb5-4636-b94c-71a936298ff1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.390681] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0923c94e-4f06-4310-bba9-cc69436848ce: rpc.has_security_group_logging(os_id): False [ 699.410129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.410280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.410352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.410787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.410787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.410919] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.411042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.411108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.411303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.411402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.411788] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.411788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.411788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.411922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.411998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.412186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.412291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.412355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.412503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.412592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.412681] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be updated. [ 699.494720] env[66131]: INFO networking_nsxv3.common.synchronization [None req-b4107a74-5ea6-4f4c-b071-19e7cc7bc7e1 None None] Enqueued Resource ID: 2f4b223f-6136-46cf-aed3-d5730a6f193e with Priority: HIGHEST for action port [ 699.495235] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4b223f-6136-46cf-aed3-d5730a6f193e with Priority: HIGHEST for action port [ 699.495547] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f4b223f-6136-46cf-aed3-d5730a6f193e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.495691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f4b223f-6136-46cf-aed3-d5730a6f193e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.495757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f4b223f-6136-46cf-aed3-d5730a6f193e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.496212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f4b223f-6136-46cf-aed3-d5730a6f193e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.496323] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f4b223f-6136-46cf-aed3-d5730a6f193e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.504070] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.504226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.504226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.504395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.504536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.517944] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: IN_PROGRESS for 2s [ 699.739814] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.740055] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.740187] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.740537] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.740697] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.740845] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 8675189d-ecb5-4636-b94c-71a936298ff1 not found, creating... [ 699.741116] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.741268] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.741375] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.741611] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.741740] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.742054] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.742204] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.742312] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.742527] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.742747] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.742889] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 8675189d-ecb5-4636-b94c-71a936298ff1 is going to be created. [ 699.763067] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.763283] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.763398] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.763667] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.763892] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.764133] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.999587] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f4b223f-6136-46cf-aed3-d5730a6f193e [ 700.000745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.000745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.000745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.000745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.000745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.000745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f4b223f-6136-46cf-aed3-d5730a6f193e already deleted. [ 700.000745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f4b223f-6136-46cf-aed3-d5730a6f193e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.520880] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c8736b9-cd19-47ba-98e2-ea5fb6c124ae req-58c9929d-df4a-4554-a4a9-b2060ef6edca service nova] Enqueued Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_rules [ 700.522433] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c8736b9-cd19-47ba-98e2-ea5fb6c124ae req-58c9929d-df4a-4554-a4a9-b2060ef6edca service nova] Enqueued Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_members [ 700.522433] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c8736b9-cd19-47ba-98e2-ea5fb6c124ae req-58c9929d-df4a-4554-a4a9-b2060ef6edca service nova] Enqueued Resource ID: 8675189d-ecb5-4636-b94c-71a936298ff1 with Priority: HIGHEST for action port [ 700.523275] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_rules [ 700.529780] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_members [ 700.529780] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8675189d-ecb5-4636-b94c-71a936298ff1 with Priority: HIGHEST for action port [ 700.529780] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.529780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.529780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.529780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.529780] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.530556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.530556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.530556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.530753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.530855] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.530984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.531345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.531345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.531345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.531554] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.532219] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-8675189d-ecb5-4636-b94c-71a936298ff1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.532351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.532415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.532566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.532637] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8675189d-ecb5-4636-b94c-71a936298ff1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.034163] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.034371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.034652] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.036055] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8675189d-ecb5-4636-b94c-71a936298ff1 with status ACTIVE [ 701.036129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.036275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.036375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.036749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.036782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.036989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.037215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.037330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.037743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.037743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.037944] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.038101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.038173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.038745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.038745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.038745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8675189d-ecb5-4636-b94c-71a936298ff1 is going to be updated. [ 701.064176] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.064354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.064469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.064764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.064915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.065089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8675189d-ecb5-4636-b94c-71a936298ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.537744] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 701.538024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.543032] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.652682] env[66131]: INFO networking_nsxv3.common.synchronization [None req-18cd1542-1a51-4d9d-854b-79aa8bb217bf None None] Enqueued Resource ID: 147b09ed-fbee-4fa8-abb0-82d9e8a35827 with Priority: HIGHEST for action port [ 701.652940] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 147b09ed-fbee-4fa8-abb0-82d9e8a35827 with Priority: HIGHEST for action port [ 701.653505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-147b09ed-fbee-4fa8-abb0-82d9e8a35827 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.653640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-147b09ed-fbee-4fa8-abb0-82d9e8a35827" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.653712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-147b09ed-fbee-4fa8-abb0-82d9e8a35827" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.653974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-147b09ed-fbee-4fa8-abb0-82d9e8a35827" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.654100] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('147b09ed-fbee-4fa8-abb0-82d9e8a35827',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.680366] env[66131]: INFO networking_nsxv3.common.synchronization [None req-a54f3e72-0eb4-43b0-9b42-ea41747b3f4b None None] Enqueued Resource ID: 73993477-601c-4d0d-9bec-048c95acb6c1 with Priority: HIGHEST for action port [ 701.680852] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73993477-601c-4d0d-9bec-048c95acb6c1 with Priority: HIGHEST for action port [ 701.681163] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-73993477-601c-4d0d-9bec-048c95acb6c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.681286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73993477-601c-4d0d-9bec-048c95acb6c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.681351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73993477-601c-4d0d-9bec-048c95acb6c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.681647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73993477-601c-4d0d-9bec-048c95acb6c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.681757] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73993477-601c-4d0d-9bec-048c95acb6c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.049030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.049030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.049030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.049030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.049030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.049030] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d is going to be created. [ 702.077026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.077026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.077026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.077026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.077026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.086769] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d in Status: UNINITIALIZED for 2s [ 702.159066] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 147b09ed-fbee-4fa8-abb0-82d9e8a35827 [ 702.159283] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.159465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.159528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.159747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.159846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.159936] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:147b09ed-fbee-4fa8-abb0-82d9e8a35827 already deleted. [ 702.160029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-147b09ed-fbee-4fa8-abb0-82d9e8a35827" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.186577] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73993477-601c-4d0d-9bec-048c95acb6c1 [ 702.187420] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.187420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.187420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.187420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.187420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.187420] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73993477-601c-4d0d-9bec-048c95acb6c1 already deleted. [ 702.187790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73993477-601c-4d0d-9bec-048c95acb6c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.518720] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e013048b-cc5c-4765-ad2b-5abb8348c80e None None] Enqueued Resource ID: 02c03c2e-05b7-4923-8cdb-d2587c674e55 with Priority: HIGHEST for action port [ 702.519485] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c03c2e-05b7-4923-8cdb-d2587c674e55 with Priority: HIGHEST for action port [ 702.519981] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-02c03c2e-05b7-4923-8cdb-d2587c674e55 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.520240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02c03c2e-05b7-4923-8cdb-d2587c674e55" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.520391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02c03c2e-05b7-4923-8cdb-d2587c674e55" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.520714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02c03c2e-05b7-4923-8cdb-d2587c674e55" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.520883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c03c2e-05b7-4923-8cdb-d2587c674e55',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.670298] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0ceb886-6a26-4f30-9338-824d8c82c0c8 req-142c91f5-8c67-45e3-9415-a58aabecd82e tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 702.670826] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 702.671225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.671362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.671438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.672731] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.672731] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.023084] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02c03c2e-05b7-4923-8cdb-d2587c674e55 [ 703.023903] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.025530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.025530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.025530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.025530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.025530] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02c03c2e-05b7-4923-8cdb-d2587c674e55 already deleted. [ 703.025530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02c03c2e-05b7-4923-8cdb-d2587c674e55" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.175273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.175553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.176565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.176872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.177052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.177279] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.177426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.177549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.177713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.177858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.177920] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 703.207649] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.207805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.207852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.208057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.208210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.218893] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 703.374557] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.374739] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.374858] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.375176] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.375424] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.375571] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.375679] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.375879] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.376937] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.377215] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.377330] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.377434] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.377543] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.377649] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.377748] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.377871] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.401452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.402365] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.402365] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.402365] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.402365] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.402659] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.402659] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.402956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.402956] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b3fc67-a3b6-45f9-bede-8e9a04a0a248',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.905833] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.906219] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.906219] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.906558] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.906712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.906859] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 not found, creating... [ 703.907132] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.907321] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.907397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.907600] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.907731] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.907997] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.908157] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.908266] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.908484] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.908573] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.908702] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 is going to be created. [ 703.928323] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.928536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.928860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.928904] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.929127] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.929342] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.098841] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d in Status: SUCCESS [ 704.098841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.098841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.098841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.098841] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.098841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.099072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.099072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.099154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.099154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.099254] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.429698] env[66131]: INFO networking_nsxv3.common.synchronization [None req-647d7a15-70ea-4d2c-9bcd-750ed3708066 None None] Enqueued Resource ID: a8eda54e-ae4f-46e6-8896-ca084ec84427 with Priority: HIGHEST for action port [ 704.429698] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8eda54e-ae4f-46e6-8896-ca084ec84427 with Priority: HIGHEST for action port [ 704.429698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8eda54e-ae4f-46e6-8896-ca084ec84427 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.430024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8eda54e-ae4f-46e6-8896-ca084ec84427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.430104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8eda54e-ae4f-46e6-8896-ca084ec84427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.430542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8eda54e-ae4f-46e6-8896-ca084ec84427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.430630] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8eda54e-ae4f-46e6-8896-ca084ec84427',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.601286] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.601473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.601639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.601861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.602036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.602162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.602227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.602379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.602464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.602550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.602691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.603024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.603024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.603024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.603150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.603696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.603696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.603696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.603696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.603696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.603696] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.658301] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0ceb886-6a26-4f30-9338-824d8c82c0c8 req-5b0d312a-a6d0-498a-86b4-f4eb1fd89d6d service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 704.658521] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0ceb886-6a26-4f30-9338-824d8c82c0c8 req-5b0d312a-a6d0-498a-86b4-f4eb1fd89d6d service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 704.658696] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0ceb886-6a26-4f30-9338-824d8c82c0c8 req-5b0d312a-a6d0-498a-86b4-f4eb1fd89d6d service nova] Enqueued Resource ID: b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 with Priority: HIGHEST for action port [ 704.659478] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 704.659670] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 704.659793] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 with Priority: HIGHEST for action port [ 704.660154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.660305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.660396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.660651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.660758] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.661803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.662755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.662755] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.662755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.662755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.662755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.663069] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b3fc67-a3b6-45f9-bede-8e9a04a0a248',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.932434] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8eda54e-ae4f-46e6-8896-ca084ec84427 [ 704.933041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.933041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.933041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.933245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.933245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.933329] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8eda54e-ae4f-46e6-8896-ca084ec84427 already deleted. [ 704.933371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8eda54e-ae4f-46e6-8896-ca084ec84427" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.940636] env[66131]: INFO networking_nsxv3.common.synchronization [req-aa5baa8a-cfbf-4cec-9940-a0e48a0792bf req-15b8188b-145d-4cd8-8e58-7f93e5a38f36 tempest-ServersTestBootFromVolume-1636949881 tempest-ServersTestBootFromVolume-1636949881-project-member] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_members [ 704.941413] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_members [ 704.943101] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.943517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.943517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.945450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.945450] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.945450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.945450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.945450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.945450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.945450] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.107483] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d: rpc.has_security_group_logging(os_id): False [ 705.126887] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.126887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.126887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.126887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.126887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.126887] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.126887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.127202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.127202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.127202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.127476] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.127575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.127575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.127986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.127986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.129023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.129140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.129238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.129435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.129531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.131015] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d is going to be created. [ 705.165079] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.165222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.165556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 with status ACTIVE [ 705.166049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.166193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.166311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.166490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.166590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.166776] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.166940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.166940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.167115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.167198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.167399] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.167493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.167673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.167759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.167759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.167949] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5b3fc67-a3b6-45f9-bede-8e9a04a0a248 is going to be updated. [ 705.193484] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.193484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.193484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.193484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.193484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.193484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5b3fc67-a3b6-45f9-bede-8e9a04a0a248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.198804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.198918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.198982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.199200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.199724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.214383] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d in Status: IN_PROGRESS for 2s [ 705.230166] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 705.230448] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 705.230634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.230859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.231354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.231819] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.231934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.231934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.232575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.232575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.232575] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.447325] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.447786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.447786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.448062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.448201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.448611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.448771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.448862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.449084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.449202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.449318] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 already deleted. [ 705.449446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.457690] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-346 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.457872] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-346" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.457972] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-346" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.458397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-346" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.459381] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.459381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.459381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.459381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.459381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.459638] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.459795] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.459930] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.460695] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.460695] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.460695] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.460695] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.481328] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.481657] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.481973] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.482397] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-346" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.482722] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-4b1be419-6cee-40ea-bba5-9b217926f6bb taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.482892] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.483016] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.483328] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.483458] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b1be419-6cee-40ea-bba5-9b217926f6bb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.549261] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6a9866af-ebd5-4619-b6d2-fa23ae7b740f None None] Enqueued Resource ID: d42a76ee-75ce-4ca9-a450-dd8e154bf9eb with Priority: HIGHEST for action port [ 705.549836] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d42a76ee-75ce-4ca9-a450-dd8e154bf9eb with Priority: HIGHEST for action port [ 705.550160] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d42a76ee-75ce-4ca9-a450-dd8e154bf9eb taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.550284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d42a76ee-75ce-4ca9-a450-dd8e154bf9eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.550350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d42a76ee-75ce-4ca9-a450-dd8e154bf9eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.550596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d42a76ee-75ce-4ca9-a450-dd8e154bf9eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.550681] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42a76ee-75ce-4ca9-a450-dd8e154bf9eb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.737940] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.989427] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.989427] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.989427] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.989427] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.989427] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.989427] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 4b1be419-6cee-40ea-bba5-9b217926f6bb not found, creating... [ 705.989912] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.989998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.990776] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.990776] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.990776] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.990987] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.996269] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.996269] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.996269] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.996269] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.996432] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 4b1be419-6cee-40ea-bba5-9b217926f6bb is going to be created. [ 706.019236] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.019487] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.019629] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.019880] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.020118] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.020323] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.057031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d42a76ee-75ce-4ca9-a450-dd8e154bf9eb [ 706.057189] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.057296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.057364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.057567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.057659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.057752] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d42a76ee-75ce-4ca9-a450-dd8e154bf9eb already deleted. [ 706.057831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d42a76ee-75ce-4ca9-a450-dd8e154bf9eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.240126] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.725327] env[66131]: INFO networking_nsxv3.common.synchronization [req-aa5baa8a-cfbf-4cec-9940-a0e48a0792bf req-ccb54a72-32c8-4ebf-8bfb-738fa0cae8d1 service nova] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_rules [ 706.725496] env[66131]: INFO networking_nsxv3.common.synchronization [req-aa5baa8a-cfbf-4cec-9940-a0e48a0792bf req-ccb54a72-32c8-4ebf-8bfb-738fa0cae8d1 service nova] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_members [ 706.725627] env[66131]: INFO networking_nsxv3.common.synchronization [req-aa5baa8a-cfbf-4cec-9940-a0e48a0792bf req-ccb54a72-32c8-4ebf-8bfb-738fa0cae8d1 service nova] Enqueued Resource ID: 4b1be419-6cee-40ea-bba5-9b217926f6bb with Priority: HIGHEST for action port [ 706.725917] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_rules [ 706.726932] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_members [ 706.727122] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1be419-6cee-40ea-bba5-9b217926f6bb with Priority: HIGHEST for action port [ 706.727692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.727855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.727940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.729130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.729130] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.729319] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.729457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.729529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.729708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.729853] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.730966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.730966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.730966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.730966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.730966] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.731228] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b1be419-6cee-40ea-bba5-9b217926f6bb taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.731228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.731228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.731341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.731385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b1be419-6cee-40ea-bba5-9b217926f6bb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.742495] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.742623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.742696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.742886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.742973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.743077] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 706.777062] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.777062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.777062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.777062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.777062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.786035] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 706.803862] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 706.804048] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 706.806074] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 706.806405] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 706.809836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.809836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.809836] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.809836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.809836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.810983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.810983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.810983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.810983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.810983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.810983] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_rules [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [req-e5a9c32f-0512-4088-831f-19a583cbab0b req-0a57d9ca-9ec0-4952-a602-27ddf702d38e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with Priority: HIGHEST for action port [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_rules [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 706.879249] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with Priority: HIGHEST for action port [ 706.884840] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 706.884840] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 706.884840] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.884840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.884840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.884840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.884840] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.884840] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.884840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.884840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.884840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.884840] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.887443] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.887443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.887443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.887443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.887443] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66bdfa9e-3e0a-48eb-ba63-da19b48e798e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.890563] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.890563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.891409] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.891409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.031432] env[66131]: INFO networking_nsxv3.common.synchronization [req-5cb5fb4d-eb01-4941-8991-0c377d272582 req-8a61fc0a-9b35-4844-acd1-b9cc93fbe5ff tempest-ListServerFiltersTestJSON-1463311190 tempest-ListServerFiltersTestJSON-1463311190-project-member] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 707.032793] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 707.033234] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.033492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.033585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.033923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.034216] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.034425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.034638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.034934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.035129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.035402] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.227485] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d in Status: SUCCESS [ 707.227730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.234497] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.235561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.235878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.235878] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b1be419-6cee-40ea-bba5-9b217926f6bb with status ACTIVE [ 707.235992] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.236122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.236191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.236400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.236487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.236651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.236757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.236813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.237041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.237041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.237299] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.237299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.237402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.237698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.237856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.237944] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b1be419-6cee-40ea-bba5-9b217926f6bb is going to be updated. [ 707.266178] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.266533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.266831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.267715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.267715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.267715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b1be419-6cee-40ea-bba5-9b217926f6bb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.323231] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.324194] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.393571] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.394345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.394345] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.394345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.394345] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with status ACTIVE [ 707.394345] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.394558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.394558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.394722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.394808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.394977] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.395084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.395145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.395317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.395377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.397349] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.398932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.399055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.399251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.399340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.399626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e is going to be updated. [ 707.433651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.433841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.433936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.434557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.434557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.434666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.538161] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.538161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.538334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.542143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.542239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.542493] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.543080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.543080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.543080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.543080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.543080] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 already deleted. [ 707.543359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.608991] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.608991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.608991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.608991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.608991] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.608991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.608991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.608991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.609440] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.609823] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.610082] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.610376] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.610650] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.610871] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.611079] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.613031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.635424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.635424] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.635424] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.635424] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.635424] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-517fc1dc-3748-4985-b6ff-7c2afff500ab taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.635424] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.635424] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.635424] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.635424] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('517fc1dc-3748-4985-b6ff-7c2afff500ab',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.740445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.826397] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.827362] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.137921] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.138460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.138621] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.138998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.139211] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.139376] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 517fc1dc-3748-4985-b6ff-7c2afff500ab not found, creating... [ 708.140357] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.140570] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.140630] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.140956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.141170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.141586] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.141780] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.142460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.142460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.142460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.142751] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 517fc1dc-3748-4985-b6ff-7c2afff500ab is going to be created. [ 708.165817] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.165817] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.165933] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.167376] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.167376] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.167376] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.243635] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.243919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.244031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.244257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.244368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.244514] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 is going to be created. [ 708.294455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.294872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.294872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.295442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.295442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.311310] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20197510-1697-4884-9af2-fab8e2bd3774 in Status: UNINITIALIZED for 2s [ 708.323828] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ee9d9cc9-7a95-4386-862a-9d5fbc043a57 None None] Enqueued Resource ID: 398cb748-8710-49c4-8cab-2c5ed610bd2e with Priority: HIGHEST for action port [ 708.324361] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398cb748-8710-49c4-8cab-2c5ed610bd2e with Priority: HIGHEST for action port [ 708.324724] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-398cb748-8710-49c4-8cab-2c5ed610bd2e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.324867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-398cb748-8710-49c4-8cab-2c5ed610bd2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.324942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-398cb748-8710-49c4-8cab-2c5ed610bd2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.325255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-398cb748-8710-49c4-8cab-2c5ed610bd2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.325352] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('398cb748-8710-49c4-8cab-2c5ed610bd2e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.329307] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.329467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.329565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.329800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.329949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.330069] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 708.331482] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.331645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.331706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.332026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.332026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.332124] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be created. [ 708.362827] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.363066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.363144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.363371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.363550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.366834] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.366979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.367036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.367233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.367373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.371863] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: UNINITIALIZED for 2s [ 708.373981] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 708.798669] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 708.798741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.799830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.799830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.801573] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.801762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.801880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.802152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.802255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.802350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.802441] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.827136] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 398cb748-8710-49c4-8cab-2c5ed610bd2e [ 708.827292] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.827488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.827488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.827831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.827831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.827831] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:398cb748-8710-49c4-8cab-2c5ed610bd2e already deleted. [ 708.827944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-398cb748-8710-49c4-8cab-2c5ed610bd2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.891806] env[66131]: INFO networking_nsxv3.common.synchronization [req-5cb5fb4d-eb01-4941-8991-0c377d272582 req-b64d6fbd-e992-4f5c-9adf-613e6972a9df service nova] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_rules [ 708.891977] env[66131]: INFO networking_nsxv3.common.synchronization [req-5cb5fb4d-eb01-4941-8991-0c377d272582 req-b64d6fbd-e992-4f5c-9adf-613e6972a9df service nova] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 708.892123] env[66131]: INFO networking_nsxv3.common.synchronization [req-5cb5fb4d-eb01-4941-8991-0c377d272582 req-b64d6fbd-e992-4f5c-9adf-613e6972a9df service nova] Enqueued Resource ID: 517fc1dc-3748-4985-b6ff-7c2afff500ab with Priority: HIGHEST for action port [ 708.893696] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_rules [ 708.893696] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 708.893696] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 517fc1dc-3748-4985-b6ff-7c2afff500ab with Priority: HIGHEST for action port [ 708.893696] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.893696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.893696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.895898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.895898] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.896079] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.897016] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.897016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.897256] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.898347] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-517fc1dc-3748-4985-b6ff-7c2afff500ab taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.898347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.898448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.898591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.898687] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('517fc1dc-3748-4985-b6ff-7c2afff500ab',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.305897] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.305897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.305897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.306366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.306366] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.306366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.306366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.306498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.306498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.307314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.307314] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.307314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.307314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.307314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.307314] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.307314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.307314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.307670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.307670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.307670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.307670] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.400164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.400328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.400553] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.401431] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 517fc1dc-3748-4985-b6ff-7c2afff500ab with status ACTIVE [ 709.401662] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.401774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.401844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.402102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.402195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.402366] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.404092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.404092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.404092] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 517fc1dc-3748-4985-b6ff-7c2afff500ab is going to be updated. [ 709.429186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.430754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.430754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.430754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.430754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.430754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-517fc1dc-3748-4985-b6ff-7c2afff500ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.810211] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4e8c15-6df2-42fb-824c-bb556c5b499a: rpc.has_security_group_logging(os_id): False [ 709.830659] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.830913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.831239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.834956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.834956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.834956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.834956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.836465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.836465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.836465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.836465] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 709.906653] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.912313] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.912313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.912313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.912313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.912313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.927729] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 710.334230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20197510-1697-4884-9af2-fab8e2bd3774 in Status: SUCCESS [ 710.334605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.334605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.334928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.335144] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.335390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.335390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.335475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.335553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.335635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.335729] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.384876] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 710.385228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.385411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.389056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.389056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.389056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.389056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.389056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.389056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.389056] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.389056] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 710.389556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.389556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.389556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.390156] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.390156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.390292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.390463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.390463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.390577] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.408983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.409161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.409225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.409455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.409547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.409655] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be created. [ 710.436582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.436755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.436755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.437135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.437135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.449671] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: UNINITIALIZED for 2s [ 710.719884] env[66131]: INFO networking_nsxv3.common.synchronization [req-a7080422-62cf-43fa-92bc-53e6de72b4e0 req-ae2ef704-0471-4171-b7b0-ca24fe9336ef tempest-ListServerFiltersTestJSON-1463311190 tempest-ListServerFiltersTestJSON-1463311190-project-member] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 710.720298] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 710.723277] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.723604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.831306] env[66131]: INFO networking_nsxv3.common.synchronization [None req-8c05ef99-45bd-4ced-b812-30650bcf579d None None] Enqueued Resource ID: a914199c-471c-43e2-b6f8-7f1e062fc879 with Priority: HIGHEST for action port [ 710.831306] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a914199c-471c-43e2-b6f8-7f1e062fc879 with Priority: HIGHEST for action port [ 710.831306] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a914199c-471c-43e2-b6f8-7f1e062fc879 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.831661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a914199c-471c-43e2-b6f8-7f1e062fc879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.831661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a914199c-471c-43e2-b6f8-7f1e062fc879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.831797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a914199c-471c-43e2-b6f8-7f1e062fc879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.831874] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a914199c-471c-43e2-b6f8-7f1e062fc879',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.837962] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.892369] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.896262] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.335230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a914199c-471c-43e2-b6f8-7f1e062fc879 [ 711.335230] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.335230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.335230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.335898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.335898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.335898] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a914199c-471c-43e2-b6f8-7f1e062fc879 already deleted. [ 711.335898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a914199c-471c-43e2-b6f8-7f1e062fc879" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.343571] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20197510-1697-4884-9af2-fab8e2bd3774: rpc.has_security_group_logging(os_id): False [ 711.363165] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.363361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.363403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.365847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.365847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.365847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.365847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.365847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.365847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.365847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.365847] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 is going to be created. [ 711.397147] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.397808] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.445224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.445681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.445849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.447713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.447713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.463638] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20197510-1697-4884-9af2-fab8e2bd3774 in Status: IN_PROGRESS for 2s [ 711.511849] env[66131]: INFO networking_nsxv3.common.synchronization [None req-0bbe4de4-26d3-4f45-b199-2e7c46e5adac None None] Enqueued Resource ID: 54122eb3-72bc-4b59-b8b0-669fe57541ab with Priority: HIGHEST for action port [ 711.512650] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54122eb3-72bc-4b59-b8b0-669fe57541ab with Priority: HIGHEST for action port [ 711.513020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-54122eb3-72bc-4b59-b8b0-669fe57541ab taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.513205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54122eb3-72bc-4b59-b8b0-669fe57541ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.513312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54122eb3-72bc-4b59-b8b0-669fe57541ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.513621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54122eb3-72bc-4b59-b8b0-669fe57541ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.513734] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54122eb3-72bc-4b59-b8b0-669fe57541ab',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.606256] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.606717] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.606717] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.607158] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.607518] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.608638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.608638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.608638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.608638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.608638] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.609059] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.609059] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.609189] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.609307] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.609600] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.609691] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.635816] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.635816] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.635816] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.635816] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.635816] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-076ff485-5d24-428f-8b83-f20f594337eb taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.637169] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.637510] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.638224] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.638563] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('076ff485-5d24-428f-8b83-f20f594337eb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.900087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.900272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.900314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.900527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.900621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.901207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be updated. [ 711.902666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.902802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.902871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.903075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.903168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.903260] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 711.947377] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.947531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.947662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.947811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.947956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.950197] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.950393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.950463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.950742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.950900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.971912] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: IN_PROGRESS for 2s [ 711.973790] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 711.977079] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 711.977079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.018806] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54122eb3-72bc-4b59-b8b0-669fe57541ab [ 712.018806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.018806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.018806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.018806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.018806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.018806] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54122eb3-72bc-4b59-b8b0-669fe57541ab already deleted. [ 712.018806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54122eb3-72bc-4b59-b8b0-669fe57541ab" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.143372] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.143372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.143372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.144321] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.144321] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.144321] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 076ff485-5d24-428f-8b83-f20f594337eb not found, creating... [ 712.144511] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.144606] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.144730] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.144998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.145800] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.145800] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.145800] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.146027] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.146234] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.147455] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.147455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 076ff485-5d24-428f-8b83-f20f594337eb is going to be created. [ 712.177206] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.177403] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.178677] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.179059] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.179340] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.179628] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.463109] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 712.463467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.463721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.465541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.465541] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.465541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.465541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.465541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.465763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.465763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.465844] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.466865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.467089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.467273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.467385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.467455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.467611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.467695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.469031] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.912189] env[66131]: INFO networking_nsxv3.common.synchronization [req-a7080422-62cf-43fa-92bc-53e6de72b4e0 req-01476004-e0e6-4340-821c-4a04d4c3806b service nova] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_rules [ 712.912418] env[66131]: INFO networking_nsxv3.common.synchronization [req-a7080422-62cf-43fa-92bc-53e6de72b4e0 req-01476004-e0e6-4340-821c-4a04d4c3806b service nova] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 712.912560] env[66131]: INFO networking_nsxv3.common.synchronization [req-a7080422-62cf-43fa-92bc-53e6de72b4e0 req-01476004-e0e6-4340-821c-4a04d4c3806b service nova] Enqueued Resource ID: 076ff485-5d24-428f-8b83-f20f594337eb with Priority: HIGHEST for action port [ 712.913943] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_rules [ 712.914460] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 712.914607] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 076ff485-5d24-428f-8b83-f20f594337eb with Priority: HIGHEST for action port [ 712.914953] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.915077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.916092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.916200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.916398] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-076ff485-5d24-428f-8b83-f20f594337eb taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.918246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.918246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.918246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.918246] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('076ff485-5d24-428f-8b83-f20f594337eb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.972669] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.972820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.972948] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.282441] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_members [ 713.282441] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 713.282441] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 713.284441] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_members [ 713.284441] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 713.284441] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 713.284441] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3724e928-c7a7-4c1d-a230-ec565cc9eb94 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.284441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.284441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.284658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.284809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.284863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.285144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.285144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.285273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.285852] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.286387] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.286574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.287012] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.287161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.358998] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_rules [ 713.359250] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_members [ 713.359436] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_rules [ 713.359603] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 713.359889] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 713.360184] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 713.360327] env[66131]: INFO networking_nsxv3.common.synchronization [req-24821d85-26cd-4a14-a84a-54211e08e7e6 req-78af8e72-b807-422b-ba5a-3f592945dd32 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with Priority: HIGHEST for action port [ 713.361443] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_rules [ 713.362103] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_rules [ 713.362300] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 713.362491] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with Priority: HIGHEST for action port [ 713.362654] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 713.362814] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_members [ 713.363703] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 713.364280] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3724e928-c7a7-4c1d-a230-ec565cc9eb94 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.364471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.364600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.365150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.365150] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.366465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.366664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.368455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.368455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.368716] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.368810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.368903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.369252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.369361] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66bdfa9e-3e0a-48eb-ba63-da19b48e798e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.370622] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.370783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.371619] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3724e928-c7a7-4c1d-a230-ec565cc9eb94 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.371900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.373426] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.373509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.385021] env[66131]: INFO networking_nsxv3.common.synchronization [req-223bdf51-cb36-4350-b448-974d220ea66a req-7687e7cc-c3fa-4d24-a36c-a2348f05c80c tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 713.386064] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 713.387762] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.388176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.388176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.388406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.388441] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.389290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.389290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.389290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.389290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.389290] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.420716] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 076ff485-5d24-428f-8b83-f20f594337eb with status ACTIVE [ 713.422688] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.422688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.422688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.422688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.422688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.422688] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.422688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.422688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.423143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.423143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.423202] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.423342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.423424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.423609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.423712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.423827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 076ff485-5d24-428f-8b83-f20f594337eb is going to be updated. [ 713.448954] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.449172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.449267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.450052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.450052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.450052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-076ff485-5d24-428f-8b83-f20f594337eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.477606] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20197510-1697-4884-9af2-fab8e2bd3774 in Status: SUCCESS [ 713.477903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.478215] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.775438] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.775664] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.775809] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.776207] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.776486] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.776708] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.776828] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.777051] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.777197] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.777437] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.777548] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.777652] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.777759] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.777988] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.777988] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.778156] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.789347] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.799556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.799766] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.799923] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.800120] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-797" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.800437] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-fe2a3f16-8126-443b-8bfd-92b42fc1554b taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.800612] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.800728] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.801077] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.801213] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2a3f16-8126-443b-8bfd-92b42fc1554b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.874550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66bdfa9e-3e0a-48eb-ba63-da19b48e798e with status ACTIVE [ 713.874792] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.874941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.875031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.875301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.875343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.875524] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.875626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.875691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.875848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.875931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.876253] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.876365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.876452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.876603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.876681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.876768] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66bdfa9e-3e0a-48eb-ba63-da19b48e798e is going to be updated. [ 713.878067] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3724e928-c7a7-4c1d-a230-ec565cc9eb94 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.878189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.893371] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.900967] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.901130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.901207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.901503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.901614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.901760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66bdfa9e-3e0a-48eb-ba63-da19b48e798e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.984094] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.985905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.985905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.988437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.988437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.988437] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 713.991434] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.994051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.994051] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.994051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.994797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.995035] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.996068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.996421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.996730] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.997025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.998424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.998424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.998424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.998424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.998424] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.999482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.999599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.000048] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.000193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.000276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.000460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.000555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.000655] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.001666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.001719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.001961] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.002105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.002188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.002390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.002479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.002644] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.038951] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.039365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.039365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.039526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.039526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.051474] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 714.162711] env[66131]: INFO networking_nsxv3.common.synchronization [None req-b1630a14-79bf-4e00-a6ed-e04cf9307fff None None] Enqueued Resource ID: fbe6fb04-e1b0-4805-9896-6905676a6557 with Priority: HIGHEST for action port [ 714.163536] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe6fb04-e1b0-4805-9896-6905676a6557 with Priority: HIGHEST for action port [ 714.164319] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe6fb04-e1b0-4805-9896-6905676a6557 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.164436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe6fb04-e1b0-4805-9896-6905676a6557" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.164675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe6fb04-e1b0-4805-9896-6905676a6557" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.164972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe6fb04-e1b0-4805-9896-6905676a6557" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.165078] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe6fb04-e1b0-4805-9896-6905676a6557',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.292821] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.304572] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.304909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.305009] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.305275] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.305586] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.305586] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port fe2a3f16-8126-443b-8bfd-92b42fc1554b not found, creating... [ 714.305917] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.306431] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.306552] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.306862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.307065] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.307355] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.307520] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.307665] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.307967] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.308132] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.308280] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: fe2a3f16-8126-443b-8bfd-92b42fc1554b is going to be created. [ 714.336992] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.337359] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.337538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.337910] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.339627] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.339927] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.395790] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.500618] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.500618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.505669] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.507542] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.507542] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.668495] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbe6fb04-e1b0-4805-9896-6905676a6557 [ 714.668495] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.668495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.668495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.668495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.668495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.668495] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbe6fb04-e1b0-4805-9896-6905676a6557 already deleted. [ 714.668495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe6fb04-e1b0-4805-9896-6905676a6557" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.796878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.797532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.797532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.797715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.797936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.797936] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 is going to be created. [ 714.824754] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.824754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.825099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.825134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.825427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.836729] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: UNINITIALIZED for 2s [ 714.898931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.899141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.899185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.899442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.900639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.900804] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 714.937948] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.938159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.938198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.938533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.938709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.953814] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 715.010692] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.011509] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.012320] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4320e0f3-4bbc-42b2-999c-7e766e099226: rpc.has_security_group_logging(os_id): False [ 715.034529] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.034771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.034771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.034967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.035058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.035278] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.035374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.035437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.036408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.036408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.036408] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be created. [ 715.069625] env[66131]: INFO networking_nsxv3.common.synchronization [req-223bdf51-cb36-4350-b448-974d220ea66a req-0623a9ba-faf8-492e-97d1-d5c3f89e489b service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 715.069625] env[66131]: INFO networking_nsxv3.common.synchronization [req-223bdf51-cb36-4350-b448-974d220ea66a req-0623a9ba-faf8-492e-97d1-d5c3f89e489b service nova] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 715.069804] env[66131]: INFO networking_nsxv3.common.synchronization [req-223bdf51-cb36-4350-b448-974d220ea66a req-0623a9ba-faf8-492e-97d1-d5c3f89e489b service nova] Enqueued Resource ID: fe2a3f16-8126-443b-8bfd-92b42fc1554b with Priority: HIGHEST for action port [ 715.071128] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_rules [ 715.071128] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 715.071128] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2a3f16-8126-443b-8bfd-92b42fc1554b with Priority: HIGHEST for action port [ 715.071128] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.071128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.071128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.071554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.071554] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.072467] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.072628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.073034] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe2a3f16-8126-443b-8bfd-92b42fc1554b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.073034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.073034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.073219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.075939] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2a3f16-8126-443b-8bfd-92b42fc1554b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.101577] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.102022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.102022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.102022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.102219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.116186] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: IN_PROGRESS for 2s [ 715.517294] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.517609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.517609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.517879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.517941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.518778] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be updated. [ 715.522285] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.523124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.523288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.523570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.523766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.524230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 715.562898] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.563109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.563182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.563505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.563693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.566176] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.566336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.566472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.566748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.566863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.574865] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.575069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.575257] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe2a3f16-8126-443b-8bfd-92b42fc1554b with status ACTIVE [ 715.575428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.575536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.575601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.575810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.575901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.576136] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.576213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.576244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.576385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.576464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.576709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.576814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.576873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.577036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.577114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.577199] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe2a3f16-8126-443b-8bfd-92b42fc1554b is going to be updated. [ 715.587819] env[66131]: INFO networking_nsxv3.common.synchronization [None req-34d46f4f-ab44-432b-9a25-6a2f3e8a7c55 tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: e6460131-d8e2-4f90-98d4-2abcac54380b with Priority: HIGHEST for action security_group_rules [ 715.588633] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6460131-d8e2-4f90-98d4-2abcac54380b with Priority: HIGHEST for action security_group_rules [ 715.589046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6460131-d8e2-4f90-98d4-2abcac54380b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.589189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.589267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.589536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.589641] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6460131-d8e2-4f90-98d4-2abcac54380b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.592061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: IN_PROGRESS for 2s [ 715.592985] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 715.601822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.602028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.602097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.602326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.602495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.602674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe2a3f16-8126-443b-8bfd-92b42fc1554b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.726913] env[66131]: INFO networking_nsxv3.common.synchronization [None req-b337bf02-6a2e-4391-a10a-a9660441b497 tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: e6460131-d8e2-4f90-98d4-2abcac54380b with Priority: HIGHEST for action security_group_rules [ 715.726913] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6460131-d8e2-4f90-98d4-2abcac54380b with Priority: HIGHEST for action security_group_rules [ 715.729209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6460131-d8e2-4f90-98d4-2abcac54380b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.729209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.057330] env[66131]: INFO networking_nsxv3.common.synchronization [req-becc4740-3f4a-4551-aab6-4fa36753b06b req-27667ef5-03c1-421e-bb2f-b7c3c35c1cd0 tempest-ListServerFiltersTestJSON-1463311190 tempest-ListServerFiltersTestJSON-1463311190-project-member] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 716.057449] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 716.057774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.057880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.064532] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 716.064820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.065539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.065779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.065969] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.066115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.066218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.066496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.066592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.066705] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.111831] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.111831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.111831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.112192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.112192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.112306] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6460131-d8e2-4f90-98d4-2abcac54380b already deleted. [ 716.112306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.112976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.113170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.113256] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6460131-d8e2-4f90-98d4-2abcac54380b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.525546] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.525846] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.525882] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.526413] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.530392] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.530613] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.530749] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.531040] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.531204] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.531423] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.531533] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.531719] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.531846] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.531976] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.532111] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.532244] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.556864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.556864] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.556864] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.556864] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-592" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.557252] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-b947c2ba-b154-4bdb-a2c2-5745d8e75add taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.557528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.557681] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.558402] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.558457] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b947c2ba-b154-4bdb-a2c2-5745d8e75add',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.570497] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.634362] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.634543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.634583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.634834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.634980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.635126] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6460131-d8e2-4f90-98d4-2abcac54380b already deleted. [ 716.635227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6460131-d8e2-4f90-98d4-2abcac54380b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.850600] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: SUCCESS [ 716.850600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.850600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.850771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.850972] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.851216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.851301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.851479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.851581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.851841] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.970117] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 716.970117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.970320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.970783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.970904] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.970966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.971143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.972876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.972876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.972876] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.060882] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.061123] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.061233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.061497] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.061716] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.061876] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port b947c2ba-b154-4bdb-a2c2-5745d8e75add not found, creating... [ 717.062283] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.062451] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.062565] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.062782] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.062918] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.063251] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.063564] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.063564] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.063749] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.063881] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.064022] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: b947c2ba-b154-4bdb-a2c2-5745d8e75add is going to be created. [ 717.072837] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.093631] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.093947] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.094120] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.096975] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.096975] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.096975] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.133308] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 717.133590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.133774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.134532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.134532] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.354551] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.477514] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.578953] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.578953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.578953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.578953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.578953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.578953] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 717.604118] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 717.604406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.604618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.604872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.605121] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.605253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.605310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.605609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.605733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.605952] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.607599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 717.607857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.608170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.608365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.608549] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.608708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.608748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.608892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.608943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.609046] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.616091] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.616091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.616091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.616091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.616327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.631521] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 717.638184] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.638380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.858743] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.921440] env[66131]: INFO networking_nsxv3.common.synchronization [req-becc4740-3f4a-4551-aab6-4fa36753b06b req-f79433ee-ce3f-4309-a272-9d36f0fd5cfc service nova] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_rules [ 717.921533] env[66131]: INFO networking_nsxv3.common.synchronization [req-becc4740-3f4a-4551-aab6-4fa36753b06b req-f79433ee-ce3f-4309-a272-9d36f0fd5cfc service nova] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 717.922375] env[66131]: INFO networking_nsxv3.common.synchronization [req-becc4740-3f4a-4551-aab6-4fa36753b06b req-f79433ee-ce3f-4309-a272-9d36f0fd5cfc service nova] Enqueued Resource ID: b947c2ba-b154-4bdb-a2c2-5745d8e75add with Priority: HIGHEST for action port [ 717.922375] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_rules [ 717.922375] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 717.922375] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b947c2ba-b154-4bdb-a2c2-5745d8e75add with Priority: HIGHEST for action port [ 717.922683] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.922786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.923355] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.923355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.923563] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b947c2ba-b154-4bdb-a2c2-5745d8e75add taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.923697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.923732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.923936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.924053] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b947c2ba-b154-4bdb-a2c2-5745d8e75add',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.979535] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.112839] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.112839] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.362211] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.362382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.362457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.362733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.362885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.363020] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 is going to be updated. [ 718.392903] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.393095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.393166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.393377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.393527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.404458] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: IN_PROGRESS for 2s [ 718.427655] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b947c2ba-b154-4bdb-a2c2-5745d8e75add with status ACTIVE [ 718.427655] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.427655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.427655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.427927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.427960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.428159] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.428260] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.428321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.428467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.428539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.428711] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.428797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.428854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.428983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.429065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.429247] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b947c2ba-b154-4bdb-a2c2-5745d8e75add is going to be updated. [ 718.453428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.453701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.453701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.454361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.454361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.454361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b947c2ba-b154-4bdb-a2c2-5745d8e75add" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.481457] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.481936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.482062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.482311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.482448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.482602] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 718.524078] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.524078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.524078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.524078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.524078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.537445] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 718.614651] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.615690] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.121024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.121024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be updated. [ 719.121024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.121024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.121024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 719.156270] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.156270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.156270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.156270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.156270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.157774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.157985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.157985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.158322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.158415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.171266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: IN_PROGRESS for 2s [ 719.172238] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 719.643689] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 719.643689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.643689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.644065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.644065] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.644065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.644186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.644261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.644342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.645959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.646042] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.646105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.646426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.646426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.646579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.646579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.646758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.648126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.648126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.648126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.648126] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.648865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.648865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.648865] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.649933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.649933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.649933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.649933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.649933] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.151153] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87932d1b-2e10-4f4e-b38c-90b3b495ce14: rpc.has_security_group_logging(os_id): False [ 720.152542] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.180694] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.180694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.181173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.181173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.181327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.181583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.181828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.181977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.182182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.182269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.182749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.182905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.182980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.183185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.183314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.183575] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.183836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.183935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.184194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.184259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.184363] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be created. [ 720.294619] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.294882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.295047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.295381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.295722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.318048] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-fb239b0e-fb73-49e4-b5e9-deeb0190042d tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 720.319924] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 720.321701] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 720.321701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.321942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.321942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.322658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.322658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.322658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.322658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.322958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.322958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.322958] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.426052] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: SUCCESS [ 720.426052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.426052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.426052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.426052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.426503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.426503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.426503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.426503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.426503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.426719] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.551255] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 720.552028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.552028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.552028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.552288] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.552488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.552596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.553372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.553684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.553684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.553954] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.655704] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.825834] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.826052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.826104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.827059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.827059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.827059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.827059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.827059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.827059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.827059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.827406] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 already deleted. [ 720.827406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.872399] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-59f5e6e3-ff4e-47df-900c-d70a70aed844 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 720.873194] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 720.873492] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.873653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.873764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.873925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.874187] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.874274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.874338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.874514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.874605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.874694] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.930384] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.057804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.058013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.058099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.058331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.058644] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.058644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.058812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.058812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.058894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.059037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.059134] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.059221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.059612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.059612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.059612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.059760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.059760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.059842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.059913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.060592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.060592] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.160075] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.160225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.160275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.160531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.164416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.164416] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 721.182552] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 721.182817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.182992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.183218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.183413] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.183545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.183610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.183769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.183873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.183966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.184146] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.184236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.184297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.184441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.184775] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.184873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.184928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.185087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.185167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.185247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.185339] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.186897] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.192044] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.192044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.192044] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.211386] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.211619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.211740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.211884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.212201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.223603] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 721.354460] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-cacf3fbe-54ce-4f80-a5da-5bb72b7b8324 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 721.354781] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 721.355727] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.355844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.378381] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.378381] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.378381] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 already deleted. [ 721.378381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.378743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.378772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.379300] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.379300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.379300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.379466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.379495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.379647] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.432596] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3724e928-c7a7-4c1d-a230-ec565cc9eb94: rpc.has_security_group_logging(os_id): False [ 721.453422] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.457052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.457052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.457052] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 is going to be created. [ 721.538744] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.538939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.538988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.539189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.539361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.553616] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: IN_PROGRESS for 2s [ 721.563152] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e016bdc-1186-4d65-a6a4-b589ea567689: rpc.has_security_group_logging(os_id): False [ 721.585425] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.585617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.585617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.586265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.586265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.586265] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.586265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.586265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.586792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.586792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.586792] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.586942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.587283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.587365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.587423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.587822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.587822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.587822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.588336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.588336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.588336] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 721.612646] env[66131]: INFO networking_nsxv3.common.synchronization [req-1d3acfbb-ae8d-4a6c-a9a0-979a8b22f2d4 req-a8374931-3b29-49c9-88f9-465e2a21fc1d tempest-VolumesAssistedSnapshotsTest-1481734445 tempest-VolumesAssistedSnapshotsTest-1481734445-project-member] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_members [ 721.614080] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGHEST for action security_group_members [ 721.616757] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.616757] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.616757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.616757] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.689508] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 721.691596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.691795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.691862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.692064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.692212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.695105] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.707875] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 721.709721] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.709857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.709933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.710201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.710343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.710722] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.710722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.710886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.710930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.710994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.711188] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.711279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.711339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.711474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.711549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.711747] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.711840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.711899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.712099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.712212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.712408] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 721.816205] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.816394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.816432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.816716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.816903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.839838] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 721.855325] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.855518] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.855632] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.855999] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.856270] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.856423] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.856534] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.856745] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.856886] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.857603] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.857603] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.857603] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.857603] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.857603] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.857799] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.857830] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.881885] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.882127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.882192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.882408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.882528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.882710] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.882807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.882891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.883217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.883328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.883405] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 already deleted. [ 721.883475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.885164] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.885337] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.885453] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.885646] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.885976] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-714946e1-a092-4577-8220-52236cecb906 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.886158] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.886313] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.886643] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.886836] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('714946e1-a092-4577-8220-52236cecb906',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.122280] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.122547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.122656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.122939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.123076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.123287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.123391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.123445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.123646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.123729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.123805] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 is going to be updated. [ 722.162485] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.163149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.163149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.163149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.163385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.175154] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 in Status: IN_PROGRESS for 2s [ 722.197685] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4320e0f3-4bbc-42b2-999c-7e766e099226: rpc.has_security_group_logging(os_id): False [ 722.226863] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.227133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.227269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.228084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.228292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.228631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.228838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.228966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.229769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.230068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.230132] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be updated. [ 722.299403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.299584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.299663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.299921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.300119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.358656] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 722.359680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.360244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.361044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.361307] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.364302] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: IN_PROGRESS for 2s [ 722.391911] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.391911] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.392350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.392505] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.392687] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.393282] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 714946e1-a092-4577-8220-52236cecb906 not found, creating... [ 722.393782] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.394100] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.394395] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.395230] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.395230] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.395230] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.395463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.395510] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.396044] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.396250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.396430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 714946e1-a092-4577-8220-52236cecb906 is going to be created. [ 722.436973] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.437792] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.438013] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.438316] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.438614] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.438887] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.865894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.865894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.180125] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-0eabbb9c-719a-4c20-88f2-20d9294d0785 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 723.180413] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-0eabbb9c-719a-4c20-88f2-20d9294d0785 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 723.180643] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-0eabbb9c-719a-4c20-88f2-20d9294d0785 service nova] Enqueued Resource ID: 714946e1-a092-4577-8220-52236cecb906 with Priority: HIGHEST for action port [ 723.185480] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 723.185705] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 723.185873] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714946e1-a092-4577-8220-52236cecb906 with Priority: HIGHEST for action port [ 723.186315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.186513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.186631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.187114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.187263] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.189384] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.190258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.190349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.190640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.190893] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.191080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.191183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.191577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.191721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.191877] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.193090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-714946e1-a092-4577-8220-52236cecb906 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.193308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.193422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.193694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.193794] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('714946e1-a092-4577-8220-52236cecb906',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.219870] env[66131]: INFO networking_nsxv3.common.synchronization [req-4677b177-675c-427f-a1c7-6e3ef0cb6602 req-e7d5c59b-aaf4-461b-8c8d-491eac10dbc7 tempest-ListImageFiltersTestJSON-907682754 tempest-ListImageFiltersTestJSON-907682754-project-member] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 723.220829] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 723.221361] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.221550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.221622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.222125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.222679] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.222679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.222679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.222884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.222932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.223101] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.237862] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 4s [ 723.567845] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: SUCCESS [ 723.568110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.632933] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.633214] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.633387] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.633735] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.634408] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.634674] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.634802] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.635233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.635422] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.635772] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.636476] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.636625] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.636755] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.636884] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.637012] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.637147] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.658828] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.658981] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.659131] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.659302] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.659622] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.659815] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.659894] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.660322] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.660470] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48af17c7-07a5-49a2-b6fb-d6b49e2aeb45',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.695521] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.695838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.695838] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.696746] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 714946e1-a092-4577-8220-52236cecb906 with status ACTIVE [ 723.697268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.697424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.697489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.697669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.697763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.698098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.698176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.698218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.698384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.698464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.698650] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.698747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.698821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.698988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.699054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.699141] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 714946e1-a092-4577-8220-52236cecb906 is going to be updated. [ 723.723863] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 723.724093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.727047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.727201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.727244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.727427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.727558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.727700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-714946e1-a092-4577-8220-52236cecb906" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.727998] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.728119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.728181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.728342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.728436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.728607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.728703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.728763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.728901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.728976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.729067] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f already deleted. [ 723.729144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.854442] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 723.854663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.854851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.855099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.855187] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.015881] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.016240] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.016240] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.016565] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.016823] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.016973] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.017128] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.017382] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.017521] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.017721] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.017828] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.017931] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.018043] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.018146] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.018244] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.018371] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.045026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.045232] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.045415] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.045611] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.045943] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-6d464d24-071e-4817-957b-ae68aa32f43c taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.046167] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.046299] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.046696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.046874] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d464d24-071e-4817-957b-ae68aa32f43c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.162646] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.162919] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.162996] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.163368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.163525] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.163676] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 not found, creating... [ 724.163936] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.164130] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.164284] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.164483] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.164613] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.164966] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.165118] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.165238] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.165509] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.165669] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.165810] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 is going to be created. [ 724.186505] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 in Status: SUCCESS [ 724.186675] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 deletion is rescheduled due to dependency. [ 724.186773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.189622] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.189887] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.189982] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.190289] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.190526] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.190760] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.200883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.357513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.357731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.357781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.357986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.358177] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.358325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.358411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.358583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.358696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.358811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.358909] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.377598] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 724.377825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.549635] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.549918] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.550038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.550341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.550518] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.550733] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 6d464d24-071e-4817-957b-ae68aa32f43c not found, creating... [ 724.551386] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.551386] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.551386] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.551669] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.551876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.552207] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.552359] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.552470] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.552706] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.552841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.553024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 6d464d24-071e-4817-957b-ae68aa32f43c is going to be created. [ 724.630803] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.631333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.631333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.632058] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.632058] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.632142] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.703406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.704114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.704114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.704114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.704289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.704401] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be created. [ 724.740162] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.740379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.740448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.740727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.740926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.764516] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: UNINITIALIZED for 2s [ 724.861431] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.861603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.861985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.861985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.862164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.862243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.862304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.862465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.862555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.862674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.862781] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.862878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.862943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.863144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.863324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.863324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.863446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.863537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.863774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.863867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.863961] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.930552] env[66131]: INFO networking_nsxv3.common.synchronization [req-4677b177-675c-427f-a1c7-6e3ef0cb6602 req-30a6af60-41dd-445b-aff4-d2fb110b4e84 service nova] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_rules [ 724.930760] env[66131]: INFO networking_nsxv3.common.synchronization [req-4677b177-675c-427f-a1c7-6e3ef0cb6602 req-30a6af60-41dd-445b-aff4-d2fb110b4e84 service nova] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 724.931790] env[66131]: INFO networking_nsxv3.common.synchronization [req-4677b177-675c-427f-a1c7-6e3ef0cb6602 req-30a6af60-41dd-445b-aff4-d2fb110b4e84 service nova] Enqueued Resource ID: 48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 with Priority: HIGHEST for action port [ 724.931790] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_rules [ 724.931790] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 724.931790] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 with Priority: HIGHEST for action port [ 724.932216] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.932788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.932985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.933219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.933328] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.937182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.937182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.937182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.937182] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.937749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.937749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.937749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.937874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.937912] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48af17c7-07a5-49a2-b6fb-d6b49e2aeb45',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.250777] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 725.251180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.251248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.251477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.251676] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.251856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.251955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.252127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.252213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.252310] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.338758] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-fea3b706-7bcf-4ce1-b7ce-7db9b7cff730 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 725.338946] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-fea3b706-7bcf-4ce1-b7ce-7db9b7cff730 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 725.339139] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-fea3b706-7bcf-4ce1-b7ce-7db9b7cff730 service nova] Enqueued Resource ID: 6d464d24-071e-4817-957b-ae68aa32f43c with Priority: HIGHEST for action port [ 725.339660] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 725.339801] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 725.339900] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d464d24-071e-4817-957b-ae68aa32f43c with Priority: HIGHEST for action port [ 725.340579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.340722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.341057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.341119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.341326] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d464d24-071e-4817-957b-ae68aa32f43c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.341464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.341560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.341820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.341935] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d464d24-071e-4817-957b-ae68aa32f43c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.366548] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 725.388883] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.389129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.389129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.389322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.389415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.389645] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.389763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.389820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.389968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.390783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.391533] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.391533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.391533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.391533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.391533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.391732] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.391732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.391816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.392035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.392035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.392127] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 725.442606] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.442606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.442924] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.444785] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 with status ACTIVE [ 725.444977] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.445110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.445178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.446359] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.446359] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.446359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.446737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.446737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.446737] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48af17c7-07a5-49a2-b6fb-d6b49e2aeb45 is going to be updated. [ 725.471807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.473153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.473292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.474272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.474272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.476599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.476797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.476797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.477057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.477171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.477276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48af17c7-07a5-49a2-b6fb-d6b49e2aeb45" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.499350] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 725.571123] env[66131]: INFO networking_nsxv3.common.synchronization [req-25620e2e-8e55-4d21-840f-cc4913d63fce req-a43995ab-8605-4fe2-9adc-abd4857524eb tempest-ServerMetadataNegativeTestJSON-1089276130 tempest-ServerMetadataNegativeTestJSON-1089276130-project-member] Enqueued Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_members [ 725.571775] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_members [ 725.572184] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.572362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.572431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.572660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.572851] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.572964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.573059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.573525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.573525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.573525] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.754494] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.846690] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d464d24-071e-4817-957b-ae68aa32f43c with status ACTIVE [ 725.847024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.847024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.847173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.847412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.847529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.848246] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.848246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.848246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.848246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.848246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.848674] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.848674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.848674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.848674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.848826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.848826] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d464d24-071e-4817-957b-ae68aa32f43c is going to be updated. [ 725.875897] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.877300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.877300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.877300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.877300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.877300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d464d24-071e-4817-957b-ae68aa32f43c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.948642] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.955509] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.955697] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-310" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.955855] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-310" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.956187] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-310" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.956474] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.956627] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.956739] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.956962] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.957118] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.957327] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.957513] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.957579] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.957619] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.957723] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.957828] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.957958] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.984514] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.986475] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.986800] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.987121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-310" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.988385] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.988797] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.989087] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.989587] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.989900] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbfee5c3-c28b-46b5-a185-d6a825c9e09c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.076540] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.076540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.076752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.077069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.077226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.077633] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.077828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.077903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.078096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.078188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.078479] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 already deleted. [ 726.078587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.257174] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.357035] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.357512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.357512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.357651] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.357895] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.358297] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.358297] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.358399] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.358497] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.358751] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.358895] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.359014] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.359122] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.359227] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.359327] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.359448] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.380239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.380457] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.380643] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.381223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-118" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.381368] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-ae6aaddf-079e-492f-b742-46c455b6a5f0 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.381663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.381803] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.382794] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.382794] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae6aaddf-079e-492f-b742-46c455b6a5f0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.464651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.464890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.465101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.465465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.465663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.465809] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be created. [ 726.492535] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.492775] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.492913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.493220] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.493366] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.493518] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port fbfee5c3-c28b-46b5-a185-d6a825c9e09c not found, creating... [ 726.493798] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.494068] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.494164] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.494342] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.494475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.494752] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.494901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.495019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.495245] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.495381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.495527] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: fbfee5c3-c28b-46b5-a185-d6a825c9e09c is going to be created. [ 726.498209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.498333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.498397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.498556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.498710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.508677] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: UNINITIALIZED for 2s [ 726.517341] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.517576] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.517651] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.517915] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.518159] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.518362] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.760802] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.761000] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.761000] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.761241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.761339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.761436] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 726.776939] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 726.777183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.777357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.777576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.777759] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.777881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.778437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.778437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.778437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.778437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.778437] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.779932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.780113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.780281] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.780388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.780453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.780586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.780667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.780758] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.809661] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.809871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.809942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.810170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.810320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.819528] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 726.886201] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.886518] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.886781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.887133] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.887289] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.887446] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port ae6aaddf-079e-492f-b742-46c455b6a5f0 not found, creating... [ 726.887723] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.887883] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.888034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.888234] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.888365] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.888648] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.888796] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.888908] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.889121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.889247] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.889380] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: ae6aaddf-079e-492f-b742-46c455b6a5f0 is going to be created. [ 726.916898] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.917144] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.917194] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.917523] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.917755] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.917972] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.245040] env[66131]: INFO networking_nsxv3.common.synchronization [req-25620e2e-8e55-4d21-840f-cc4913d63fce req-9ac7168b-7759-4b2c-bd79-a1ec7bbf8530 service nova] Enqueued Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_rules [ 727.245040] env[66131]: INFO networking_nsxv3.common.synchronization [req-25620e2e-8e55-4d21-840f-cc4913d63fce req-9ac7168b-7759-4b2c-bd79-a1ec7bbf8530 service nova] Enqueued Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_members [ 727.245040] env[66131]: INFO networking_nsxv3.common.synchronization [req-25620e2e-8e55-4d21-840f-cc4913d63fce req-9ac7168b-7759-4b2c-bd79-a1ec7bbf8530 service nova] Enqueued Resource ID: fbfee5c3-c28b-46b5-a185-d6a825c9e09c with Priority: HIGHEST for action port [ 727.245040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_rules [ 727.245040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_members [ 727.245040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfee5c3-c28b-46b5-a185-d6a825c9e09c with Priority: HIGHEST for action port [ 727.245040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.245040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.245040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.245814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.245992] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.248422] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.248693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.248874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.249161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.249607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.249825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.250029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.250457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.250741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.250930] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.253384] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.253384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.253384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.253384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.253384] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbfee5c3-c28b-46b5-a185-d6a825c9e09c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.281348] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.281647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.282997] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.525555] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 727.525879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.683235] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-814c9996-247c-4128-a2e9-2512dc93e75b service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 727.683370] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-814c9996-247c-4128-a2e9-2512dc93e75b service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 727.683496] env[66131]: INFO networking_nsxv3.common.synchronization [req-9c7371de-3ed8-4f10-836c-6ea0effdee46 req-814c9996-247c-4128-a2e9-2512dc93e75b service nova] Enqueued Resource ID: ae6aaddf-079e-492f-b742-46c455b6a5f0 with Priority: HIGHEST for action port [ 727.683739] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 727.683867] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 727.683962] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6aaddf-079e-492f-b742-46c455b6a5f0 with Priority: HIGHEST for action port [ 727.684698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.684698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.688235] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.688356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.689035] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae6aaddf-079e-492f-b742-46c455b6a5f0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.689164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.689232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.690092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.690092] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae6aaddf-079e-492f-b742-46c455b6a5f0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.754778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.755913] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.756083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.756192] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbfee5c3-c28b-46b5-a185-d6a825c9e09c with status ACTIVE [ 727.756364] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.756486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.756542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.756727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.756823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.756995] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.757102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.757166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.757315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.757396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.757820] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.757820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.757820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.757937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.757937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.758018] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbfee5c3-c28b-46b5-a185-d6a825c9e09c is going to be updated. [ 727.785963] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.786148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.786224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.786445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.786581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.786773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbfee5c3-c28b-46b5-a185-d6a825c9e09c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.787074] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.191983] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae6aaddf-079e-492f-b742-46c455b6a5f0 with status ACTIVE [ 728.191983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.192479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.192479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.192479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.192633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.192805] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.193431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.193431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.193431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.193431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.193431] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.193431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.193698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.193698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.193698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.194128] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae6aaddf-079e-492f-b742-46c455b6a5f0 is going to be updated. [ 728.222575] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.222819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.222925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.223087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.223250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.223435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae6aaddf-079e-492f-b742-46c455b6a5f0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.262458] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.290179] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.290457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.290457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.290737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.290737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.290964] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 728.344146] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.344291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.344379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.344682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.344979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.358694] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 728.521402] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 728.521402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.521500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.521695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.521928] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.522133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.522133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.522560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.522560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.522560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.522560] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.765563] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.765683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.765781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.766133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.766217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.770030] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 is going to be created. [ 728.799424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.800433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.800433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.801411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.801716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.815746] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 in Status: UNINITIALIZED for 2s [ 728.834133] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 728.834424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.834668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.834971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.835262] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.835439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.835528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.835744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.835874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.835987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.836134] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.026014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.026014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.026014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.026014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.026391] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.026391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.026391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.026391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.026600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.026600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.027616] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.027616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.027616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.027616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.029026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.029026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.029026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.029026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.029026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.029464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.029603] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.339977] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.339977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.339977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.339977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.339977] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.341533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.341533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.341533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.341533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.341533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.342241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.342241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.342241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.342241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.342241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.342842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.342842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.342842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.342842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.342842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.342842] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.534106] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9664a1c4-6b34-480a-af3f-b95cb52e088f: rpc.has_security_group_logging(os_id): False [ 729.559584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.560020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.560105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.560354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.560452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.560678] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.561056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.561056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.561168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.561240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.561470] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.561556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.561604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.561732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.561902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.562698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.562698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.562698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.562698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.562698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.562698] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be created. [ 729.642774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.642774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.642774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.642774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.642774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.656569] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 729.845496] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87932d1b-2e10-4f4e-b38c-90b3b495ce14: rpc.has_security_group_logging(os_id): False [ 729.864784] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.867036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.867036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.867036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.867508] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.867853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.868170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.868522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.869161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.869161] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 729.955120] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.955120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.955120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.955120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.955120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.970510] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 730.371599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 730.371979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.374349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.375666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.375666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.375666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.376276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.376276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.376378] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.376542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.376639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.376814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.376939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.377062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.377477] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.379011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.379109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.379301] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.379896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.381661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.381909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.382041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.382187] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.826641] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 in Status: SUCCESS [ 730.826887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.827077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.827313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.827790] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.827790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.827956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.828065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.828157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.828482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.828624] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.884587] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f876b0-0618-417d-b11e-0e430c4a1630: rpc.has_security_group_logging(os_id): False [ 730.887313] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.907882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.907882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.907882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.907882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.907882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.907882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.907882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.908376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.908376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.908376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.908930] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.908930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.909101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.909281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.909422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.909702] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.909907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.910061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.910278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.910417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.910560] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be created. [ 730.992584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.993714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.993714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.993714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.993714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.010762] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 731.331836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.332086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.332086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.332259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.332411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.332527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.332585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.332752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.332861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.332951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.333124] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.333234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.333371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.333441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.333542] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.333618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.333681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.333815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.333893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.333977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.334082] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.389950] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.427354] env[66131]: INFO networking_nsxv3.common.synchronization [req-27bd67ef-8d9d-448d-93f4-de1c8f79ab2f req-e4299bb8-a547-424e-ad43-2f71bbb69ff7 tempest-InstanceActionsV221TestJSON-538750641 tempest-InstanceActionsV221TestJSON-538750641-project-member] Enqueued Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_members [ 731.427429] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_members [ 731.428415] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.428589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.428717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.429017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.429368] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.429568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.429644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.429927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.430091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.430241] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.671535] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 731.671535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.837125] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d46ac8a-ba3b-4036-8bf0-647896954581: rpc.has_security_group_logging(os_id): False [ 731.862412] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.862605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.862659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.862919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.863033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.863505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.863505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.863505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.863717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.863717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.863833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.863936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.864018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.864148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.864216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.864392] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.864501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.864559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.864772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.864772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.864882] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 is going to be created. [ 731.892583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.892728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.893362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.893362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.893362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.893362] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 731.924150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.924329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.924401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.924635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.924789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.934579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.934579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.934579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.935869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.935974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.936211] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.936753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.936753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.936753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.936753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.937462] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 already deleted. [ 731.937611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.940394] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 731.942598] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.942598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-841" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.942598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-841" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.942598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-841" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.942598] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.942598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.943121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.943121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.943121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.943437] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.943584] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.943715] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.943845] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.943992] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.944243] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.944412] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.946891] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.947074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.947175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.947374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.947576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.969226] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 in Status: IN_PROGRESS for 2s [ 731.981162] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.981346] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.981476] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.981651] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-841" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.982101] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-0a695091-fe3b-4484-88fc-4719e504c10e taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.983461] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.983461] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.983461] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.983461] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a695091-fe3b-4484-88fc-4719e504c10e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.001313] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 732.001313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.001313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.001313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.001313] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.030903] env[66131]: INFO networking_nsxv3.common.synchronization [req-1042b2d8-8f90-4799-9772-6a6daba8cd71 req-684d659c-d740-4d9b-ae19-2b711f8195a3 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 732.031677] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 732.032256] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.032399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.032485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.033080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.033080] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.033080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.033080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.033445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.033445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.033445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.487282] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.487727] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.487727] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.487998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.488184] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.489048] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 0a695091-fe3b-4484-88fc-4719e504c10e not found, creating... [ 732.489048] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.489048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.489269] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.489407] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.489555] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.490064] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.490256] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.490375] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.490613] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.490754] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.491122] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 0a695091-fe3b-4484-88fc-4719e504c10e is going to be created. [ 732.503435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.503646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.503780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.504114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.504369] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.504530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.520320] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.521071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.521071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.521071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.521306] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.521468] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.536143] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.536288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.536386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.536691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.536837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.537055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.537159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.537215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.537373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.537451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.537537] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 732.601247] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.601452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.601452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.601647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.601848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.621477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 733.008291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.008543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.008543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.008821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.009019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.009113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.009179] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.009733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.009881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.010025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.010204] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.010304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.010362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.010551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.010724] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.010849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.011308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.011491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.011604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.011698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.011828] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.028114] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 733.028367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.028548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.028757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.028843] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.296705] env[66131]: INFO networking_nsxv3.common.synchronization [req-27bd67ef-8d9d-448d-93f4-de1c8f79ab2f req-3b4698b5-1904-4748-987a-1ced825c60c7 service nova] Enqueued Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_rules [ 733.297345] env[66131]: INFO networking_nsxv3.common.synchronization [req-27bd67ef-8d9d-448d-93f4-de1c8f79ab2f req-3b4698b5-1904-4748-987a-1ced825c60c7 service nova] Enqueued Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_members [ 733.297345] env[66131]: INFO networking_nsxv3.common.synchronization [req-27bd67ef-8d9d-448d-93f4-de1c8f79ab2f req-3b4698b5-1904-4748-987a-1ced825c60c7 service nova] Enqueued Resource ID: 0a695091-fe3b-4484-88fc-4719e504c10e with Priority: HIGHEST for action port [ 733.300129] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_rules [ 733.300129] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_members [ 733.300129] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a695091-fe3b-4484-88fc-4719e504c10e with Priority: HIGHEST for action port [ 733.300383] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.301472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.301472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.301472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.301472] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.303463] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.303463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.303463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.303463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.304273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.308631] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.308631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a695091-fe3b-4484-88fc-4719e504c10e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.308631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.308631] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a695091-fe3b-4484-88fc-4719e504c10e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.515337] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87932d1b-2e10-4f4e-b38c-90b3b495ce14: rpc.has_security_group_logging(os_id): False [ 733.532420] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.532420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.544038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.544038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.544038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.544038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.544922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.544992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.545145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.545401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.545493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.545562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.545755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.545858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.545959] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 733.654020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.654268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.654618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.655407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.655998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.684728] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 733.809106] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.810330] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.810496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.810623] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a695091-fe3b-4484-88fc-4719e504c10e with status ACTIVE [ 733.810794] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.811072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.811072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.811301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.812068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.812068] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.816033] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.816033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.816033] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a695091-fe3b-4484-88fc-4719e504c10e is going to be updated. [ 733.849397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.849546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.849618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.849879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.850089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.850231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a695091-fe3b-4484-88fc-4719e504c10e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.954512] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 733.954795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.954989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.955235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.955500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.955631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.955665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.955830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.955918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.956014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.956107] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.983494] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 in Status: SUCCESS [ 733.983761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.316424] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.461466] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.461614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.462132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.462132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.462247] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.462421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.462495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.462675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.462773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.462877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.463050] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.463196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.463240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.463391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.463545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.463710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.463710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.463865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.463954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.464837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.464837] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.467121] env[66131]: INFO networking_nsxv3.common.synchronization [req-4a2c146b-a350-4dcf-9683-a2a4bdee83c7 req-50190a90-c9a8-4912-9c8a-5ad6fd0f6406 tempest-ServerAddressesNegativeTestJSON-711752863 tempest-ServerAddressesNegativeTestJSON-711752863-project-member] Enqueued Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_members [ 734.469127] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_members [ 734.469127] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.469127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.469127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.469127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.469127] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.469127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.469127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.469489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.469489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.469489] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.630033] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 734.630411] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 734.630411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.712700] env[66131]: INFO networking_nsxv3.common.synchronization [req-0b184cfc-282e-44af-9613-62cc5ce4e78e req-a7bfb076-ab2a-4905-a71f-e46f8e983c2d tempest-FloatingIPsAssociationNegativeTestJSON-937727895 tempest-FloatingIPsAssociationNegativeTestJSON-937727895-project-member] Enqueued Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_members [ 734.713395] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fc9052-f286-4d53-8d9d-b976649d992e with Priority: HIGHEST for action security_group_members [ 734.714088] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7fc9052-f286-4d53-8d9d-b976649d992e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.714088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.714088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.714452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.714601] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.714714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.714778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.715068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.715068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.715188] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7fc9052-f286-4d53-8d9d-b976649d992e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.818572] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.818742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.818800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.819037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.819144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.819287] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 is going to be created. [ 734.851802] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.852025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.852121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.852358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.852536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.865265] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 in Status: UNINITIALIZED for 2s [ 734.968371] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f876b0-0618-417d-b11e-0e430c4a1630: rpc.has_security_group_logging(os_id): False [ 734.974533] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.974777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.974888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.975177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.975338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.975594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.975721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.975775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.976493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.976493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.976493] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b940b435-c759-4394-856d-7ee660b5983d already deleted. [ 734.976493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.992577] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.992765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.992854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.993152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.993283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.993528] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.993651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.993732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.993912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.993999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.994264] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.994381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.994466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.994629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.994721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.998112] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.999037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.999037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.999037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.999037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.999037] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 735.074301] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.074453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.075277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.075492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.075652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.092656] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 735.106401] env[66131]: INFO networking_nsxv3.common.synchronization [req-39fac6e4-5969-4fb4-894b-bb8f7bcd58cb req-cba82d9e-58af-4097-94b2-1b18f088e90f tempest-ListServersNegativeTestJSON-681533543 tempest-ListServersNegativeTestJSON-681533543-project-member] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 735.106994] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 735.107990] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.108180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.108237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.108498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.108679] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.108830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.109159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.109159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.109159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.109471] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.154536] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.154840] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-317" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.155554] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-317" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.156158] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-317" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.157909] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.157909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.157909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.157909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.157909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.157909] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.157909] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.157909] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.158540] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.158540] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.158540] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.158540] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.182934] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.182934] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.182934] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.183194] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-317" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.183850] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-93c79930-6d8b-4177-9123-0e1efb58911a taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.183850] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.183850] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.184272] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.184453] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c79930-6d8b-4177-9123-0e1efb58911a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.220515] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.220515] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.220515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.220515] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fc9052-f286-4d53-8d9d-b976649d992e is going to be updated. [ 735.253859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.254034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.254108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.254444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.254529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.264775] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fc9052-f286-4d53-8d9d-b976649d992e in Status: IN_PROGRESS for 2s [ 735.403879] env[66131]: INFO networking_nsxv3.common.synchronization [req-781c5f6f-d9f4-4e5f-89dd-8750c9819f13 req-986fb91a-a04b-4be5-b739-cc55df6b6bdc tempest-FloatingIPsAssociationTestJSON-1405363732 tempest-FloatingIPsAssociationTestJSON-1405363732-project-member] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 735.404668] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 735.405083] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.405221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.405304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.405556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.405714] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.405813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.405879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.406105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.406202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.406300] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.613109] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.688572] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.689019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.689019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.689348] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.689525] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.689691] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 93c79930-6d8b-4177-9123-0e1efb58911a not found, creating... [ 735.689966] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.690134] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.690259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.690540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.690680] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.690964] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.691129] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.691238] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.691434] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.691573] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.691707] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 93c79930-6d8b-4177-9123-0e1efb58911a is going to be created. [ 735.725906] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 735.726182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.729777] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.729874] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.729983] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.730382] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.730635] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.730955] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.913084] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.119118] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.413991] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.528615] env[66131]: INFO networking_nsxv3.common.synchronization [req-4a2c146b-a350-4dcf-9683-a2a4bdee83c7 req-076d49c1-ca05-41ca-8754-6a7c41c31458 service nova] Enqueued Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_rules [ 736.529363] env[66131]: INFO networking_nsxv3.common.synchronization [req-4a2c146b-a350-4dcf-9683-a2a4bdee83c7 req-076d49c1-ca05-41ca-8754-6a7c41c31458 service nova] Enqueued Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_members [ 736.529363] env[66131]: INFO networking_nsxv3.common.synchronization [req-4a2c146b-a350-4dcf-9683-a2a4bdee83c7 req-076d49c1-ca05-41ca-8754-6a7c41c31458 service nova] Enqueued Resource ID: 93c79930-6d8b-4177-9123-0e1efb58911a with Priority: HIGHEST for action port [ 736.532201] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_rules [ 736.532201] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_members [ 736.532201] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93c79930-6d8b-4177-9123-0e1efb58911a with Priority: HIGHEST for action port [ 736.532201] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.532201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.532201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.532201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.532201] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.532845] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.532845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.532845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.533053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.533208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.533300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.533393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.533518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.533597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.533671] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.534808] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-93c79930-6d8b-4177-9123-0e1efb58911a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.534808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.534808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.534808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.535495] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c79930-6d8b-4177-9123-0e1efb58911a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.614449] env[66131]: INFO networking_nsxv3.common.synchronization [req-d1a8369e-a7cb-4f73-a4af-15febce53e8a req-2bf12a03-085d-4161-959e-4508910afa0a tempest-ListServersNegativeTestJSON-681533543 tempest-ListServersNegativeTestJSON-681533543-project-member] Enqueued Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 736.615209] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b with Priority: HIGHEST for action security_group_members [ 736.615617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.615774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.625269] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.625269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.625269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.625269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.625269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.625269] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 736.668085] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.668281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.668344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.668547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.668715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.682677] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 736.876480] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 in Status: SUCCESS [ 736.876729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.876765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.877016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.877290] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.877414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.877479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.877697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.877817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.877926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.878031] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.917374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.917511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.917555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.917792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.917918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.918034] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be updated. [ 736.951055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.951055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.951055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.951419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.951419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.963439] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: IN_PROGRESS for 2s [ 737.037620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.038161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.038161] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.040287] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93c79930-6d8b-4177-9123-0e1efb58911a with status ACTIVE [ 737.040287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.040287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.040287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.040287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.040287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.040287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.040710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.040710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.040710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.040710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.040825] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.040892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.040949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.041365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.041365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.041365] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93c79930-6d8b-4177-9123-0e1efb58911a is going to be updated. [ 737.073306] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.073306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.073306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.076590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.076832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.077058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93c79930-6d8b-4177-9123-0e1efb58911a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.121986] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 737.124705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.124705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.124705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.124705] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.278536] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7fc9052-f286-4d53-8d9d-b976649d992e in Status: SUCCESS [ 737.278703] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7fc9052-f286-4d53-8d9d-b976649d992e deletion is rescheduled due to dependency. [ 737.278823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7fc9052-f286-4d53-8d9d-b976649d992e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.382339] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.382537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.382692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.383247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.383438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.383638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.383800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.384021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.384120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.384245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.384491] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.384587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.384653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.384863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.385090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.385270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.385369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.385550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.385657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.385827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.385974] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.543895] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.627644] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.627801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.627868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.628098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.628263] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.628361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.628422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.628566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.628691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.628724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.628814] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.888575] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1748825f-41ff-4cb0-8413-0bbb18bc3793: rpc.has_security_group_logging(os_id): False [ 737.910405] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.910580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.910632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.910870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.910964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.911811] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.912368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.912368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.912368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.912368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.912521] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.912568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.912604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.912762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.912819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.912994] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.914284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.914391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.914547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.914652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.914769] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 is going to be created. [ 737.988802] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.989017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.989084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.989279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.989454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.001477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 in Status: IN_PROGRESS for 2s [ 738.047500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.047776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.047776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.048042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.048152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.048270] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b940b435-c759-4394-856d-7ee660b5983d is going to be created. [ 738.096578] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.096678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.096723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.096921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.097120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.122409] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b940b435-c759-4394-856d-7ee660b5983d in Status: UNINITIALIZED for 2s [ 738.131276] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.131440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.131513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.131735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.132054] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.132180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.132243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.132413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.132504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.132592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.132741] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.132836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.132886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.133623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.133955] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.134263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.134404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.134693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.134693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.134786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.134847] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.640064] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f876b0-0618-417d-b11e-0e430c4a1630: rpc.has_security_group_logging(os_id): False [ 738.652605] env[66131]: INFO networking_nsxv3.common.synchronization [req-9ef71c1e-b165-4b01-9c0a-814a76b6d84f req-5b52fb68-328e-403c-ac4a-03a434d22d71 tempest-ServersNegativeTestJSON-775626346 tempest-ServersNegativeTestJSON-775626346-project-member] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 738.653685] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 738.654232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.654566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.654800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.657017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.657017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.657017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.657017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.657017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.657017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.657017] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.660019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.660150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.660219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.660405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.660494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.660901] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.660901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.661031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.661107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.661189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.661367] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.661460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.661521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.661657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.661733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.662176] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.662176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.662176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.662319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.662423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.662517] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 738.693272] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 738.693272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.693520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.693622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.693878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.694023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.694092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.694902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.694902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.694902] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('091418bc-6d4e-4be2-bfdc-783bb4e9e92b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.728612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.728819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.728926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.729262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.729466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.748406] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 738.974555] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 738.974862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.110022] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.110221] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.110341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.110685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.110971] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.113872] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.114095] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.114342] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.114488] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.114743] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.114858] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.114964] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.115083] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.115192] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.115284] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.115408] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.135718] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.135718] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.135718] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.135718] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.135718] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-fe31c11e-3a38-45cd-a499-a846a487aa48 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.135718] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.136159] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.136159] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.136470] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe31c11e-3a38-45cd-a499-a846a487aa48',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.159535] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.159823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.159926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.160137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.160273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.160525] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.160729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.160729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.160931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.161069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.161168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 already deleted. [ 739.161356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.197220] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.197461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.197461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.197710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.197760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.197970] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.198093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.198144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.198373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.198506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.198659] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b is going to be updated. [ 739.235013] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.235013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.235013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.235013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.235013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.244512] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: IN_PROGRESS for 2s [ 739.638640] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.638876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.639012] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.639313] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.639493] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.639665] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port fe31c11e-3a38-45cd-a499-a846a487aa48 not found, creating... [ 739.639980] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.640159] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.640272] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.640563] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.640717] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.641059] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.641217] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.641321] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.641563] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.641696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.641827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: fe31c11e-3a38-45cd-a499-a846a487aa48 is going to be created. [ 739.664815] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.665047] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.665173] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.665453] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.665678] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.665901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.840313] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5574aec7-734f-436f-a1f9-b1447924db74 None None] Enqueued Resource ID: b71ac7bb-2aa9-41ef-b556-19ee61d5a26b with Priority: HIGHEST for action port [ 739.840911] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71ac7bb-2aa9-41ef-b556-19ee61d5a26b with Priority: HIGHEST for action port [ 739.841264] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b71ac7bb-2aa9-41ef-b556-19ee61d5a26b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.841399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b71ac7bb-2aa9-41ef-b556-19ee61d5a26b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.841511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b71ac7bb-2aa9-41ef-b556-19ee61d5a26b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.842023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b71ac7bb-2aa9-41ef-b556-19ee61d5a26b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.842275] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71ac7bb-2aa9-41ef-b556-19ee61d5a26b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.018546] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 in Status: SUCCESS [ 740.018923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.133105] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b940b435-c759-4394-856d-7ee660b5983d in Status: SUCCESS [ 740.133474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.133643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.133861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.134077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.134222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.134315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.134491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.134571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134743] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.344540] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b71ac7bb-2aa9-41ef-b556-19ee61d5a26b [ 740.344803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.344969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.345085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.345366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.345494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.345560] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b71ac7bb-2aa9-41ef-b556-19ee61d5a26b already deleted. [ 740.345639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b71ac7bb-2aa9-41ef-b556-19ee61d5a26b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.443063] env[66131]: INFO networking_nsxv3.common.synchronization [req-9ef71c1e-b165-4b01-9c0a-814a76b6d84f req-a2ad5804-fa2e-4954-aeeb-ed19cbc2ec24 service nova] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_rules [ 740.445446] env[66131]: INFO networking_nsxv3.common.synchronization [req-9ef71c1e-b165-4b01-9c0a-814a76b6d84f req-a2ad5804-fa2e-4954-aeeb-ed19cbc2ec24 service nova] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 740.445446] env[66131]: INFO networking_nsxv3.common.synchronization [req-9ef71c1e-b165-4b01-9c0a-814a76b6d84f req-a2ad5804-fa2e-4954-aeeb-ed19cbc2ec24 service nova] Enqueued Resource ID: fe31c11e-3a38-45cd-a499-a846a487aa48 with Priority: HIGHEST for action port [ 740.445446] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_rules [ 740.445446] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 740.445446] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe31c11e-3a38-45cd-a499-a846a487aa48 with Priority: HIGHEST for action port [ 740.445446] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.445446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.445446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.445446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.445446] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.446444] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.447313] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.447313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.447624] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.449272] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe31c11e-3a38-45cd-a499-a846a487aa48 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.449359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.449417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.449660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.449660] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe31c11e-3a38-45cd-a499-a846a487aa48',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.637393] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.637560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.637633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.637949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.638193] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.638358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.638461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.638698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.638789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.639342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.639342] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.639342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.639342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.639539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.639617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.639728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.639969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.640255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.640388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.640499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.640586] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.766548] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 740.766548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.951297] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.952888] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.952888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.952888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe31c11e-3a38-45cd-a499-a846a487aa48 with status ACTIVE [ 740.953143] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.953205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.953553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.953553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.953553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.953726] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.954373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.954373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.954373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.954373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.954373] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.954560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.954560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.954651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.954755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.954806] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe31c11e-3a38-45cd-a499-a846a487aa48 is going to be updated. [ 740.977834] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.978316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.978316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.979403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.979403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.979403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.144712] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b940b435-c759-4394-856d-7ee660b5983d: rpc.has_security_group_logging(os_id): False [ 741.170050] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.171077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.171077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.171077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.171077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.171077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.172207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.172207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.172207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.172207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.172207] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.172207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.172207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.172429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.172429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.172725] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.172903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.172903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.172984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.173070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.173170] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b940b435-c759-4394-856d-7ee660b5983d is going to be created. [ 741.276295] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b in Status: SUCCESS [ 741.276622] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 091418bc-6d4e-4be2-bfdc-783bb4e9e92b deletion is rescheduled due to dependency. [ 741.278181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-091418bc-6d4e-4be2-bfdc-783bb4e9e92b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.279573] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.279984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.280147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.280463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.281374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.304095] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b940b435-c759-4394-856d-7ee660b5983d in Status: IN_PROGRESS for 2s [ 741.459537] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.510523] env[66131]: INFO networking_nsxv3.common.synchronization [req-ee3ee2b4-0db0-42ae-8856-fa3b872a90dc req-b6b63b63-ffd6-47ca-b720-cbf6cc633d37 tempest-ListImageFiltersTestJSON-907682754 tempest-ListImageFiltersTestJSON-907682754-project-member] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 741.511270] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 741.511648] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.511648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.511648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.511896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.512012] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.514888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.514960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.515160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.515274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.515341] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.961763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.961942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.962025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.962278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.962436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.962554] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be created. [ 741.970218] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.970451] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.970537] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.970921] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.971115] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.971289] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.971405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.971621] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.971762] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.971987] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.972290] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.972290] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.972290] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.972441] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.972534] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.972666] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.995953] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.995953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.995953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.996896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.996896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.998840] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.999011] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.999151] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.999312] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.999748] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.000083] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.000083] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.000225] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.000357] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac8b37b-46d6-4e52-9c9f-31977c0b1e54',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.023032] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: UNINITIALIZED for 2s [ 742.023237] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.267569] env[66131]: INFO networking_nsxv3.common.synchronization [None req-43aa5cf4-3fc2-4bd7-9ea8-483b07edc83e None None] Enqueued Resource ID: 24966659-a930-45f4-b247-80040ed04134 with Priority: HIGHEST for action port [ 742.268469] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24966659-a930-45f4-b247-80040ed04134 with Priority: HIGHEST for action port [ 742.269658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-24966659-a930-45f4-b247-80040ed04134 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.269977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24966659-a930-45f4-b247-80040ed04134" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.270124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24966659-a930-45f4-b247-80040ed04134" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.270425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24966659-a930-45f4-b247-80040ed04134" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.270504] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24966659-a930-45f4-b247-80040ed04134',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.503796] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.503796] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.503985] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.505287] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.505457] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.506061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port aac8b37b-46d6-4e52-9c9f-31977c0b1e54 not found, creating... [ 742.506235] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.506450] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.506511] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.506738] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.506938] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.507593] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.507593] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.507593] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.507869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.507903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.510427] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: aac8b37b-46d6-4e52-9c9f-31977c0b1e54 is going to be created. [ 742.530263] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.535950] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.535950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.535950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.535950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.535950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.535950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.774016] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24966659-a930-45f4-b247-80040ed04134 [ 742.774401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.777110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.777233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.777422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.777514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.777615] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24966659-a930-45f4-b247-80040ed04134 already deleted. [ 742.777699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24966659-a930-45f4-b247-80040ed04134" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.033138] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.033425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.033478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.033772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.033885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.034043] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be updated. [ 743.078410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.078567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.079206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.079527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.079722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.091010] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 743.319121] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b940b435-c759-4394-856d-7ee660b5983d in Status: SUCCESS [ 743.319639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.355588] env[66131]: INFO networking_nsxv3.common.synchronization [req-ee3ee2b4-0db0-42ae-8856-fa3b872a90dc req-c303addb-e1bc-4c6b-8526-4fd346f7721b service nova] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_rules [ 743.355588] env[66131]: INFO networking_nsxv3.common.synchronization [req-ee3ee2b4-0db0-42ae-8856-fa3b872a90dc req-c303addb-e1bc-4c6b-8526-4fd346f7721b service nova] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 743.355588] env[66131]: INFO networking_nsxv3.common.synchronization [req-ee3ee2b4-0db0-42ae-8856-fa3b872a90dc req-c303addb-e1bc-4c6b-8526-4fd346f7721b service nova] Enqueued Resource ID: aac8b37b-46d6-4e52-9c9f-31977c0b1e54 with Priority: HIGHEST for action port [ 743.355737] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_rules [ 743.355873] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 743.356070] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac8b37b-46d6-4e52-9c9f-31977c0b1e54 with Priority: HIGHEST for action port [ 743.356487] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.356653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.356760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.356999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357138] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.358267] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.358386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.358692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.358798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.358926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.359309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.359437] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac8b37b-46d6-4e52-9c9f-31977c0b1e54',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.862175] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.862305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.862535] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac8b37b-46d6-4e52-9c9f-31977c0b1e54 with status ACTIVE [ 743.862657] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.862767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.862830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.863105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.863279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.863440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.863664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.863733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.863907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.863986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.864181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.864272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.864582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.865076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.865076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.865076] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac8b37b-46d6-4e52-9c9f-31977c0b1e54 is going to be updated. [ 743.887733] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.887733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.887733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.887733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.887733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.888056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac8b37b-46d6-4e52-9c9f-31977c0b1e54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.034585] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 744.034827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.035011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.035636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.035636] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.035636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.035636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.036024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.036024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.036024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.036146] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.539435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.539736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.539848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.540283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.540563] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.540726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.540867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.541140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.541285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.541429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.541663] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.541796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.541967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.542249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.542478] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.542656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.542756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.543032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.543108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.543294] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.543433] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.583152] env[66131]: INFO networking_nsxv3.common.synchronization [req-f0d20ae0-2e63-4b2b-9ee6-0532f3e55678 req-1de07963-c73a-4303-a091-edeb5980fa03 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 744.583363] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 744.584289] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.584557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.584689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.584986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.585287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.585473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.585589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.585842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.585993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.586183] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.957351] env[66131]: INFO networking_nsxv3.common.synchronization [req-f0d20ae0-2e63-4b2b-9ee6-0532f3e55678 req-b8abe2dd-2bf9-4c5b-87cf-77024be11328 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 744.957351] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 744.957577] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.957577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.046074] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f85143-50cb-4ea4-b72b-837126da5251: rpc.has_security_group_logging(os_id): False [ 745.069011] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.069011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.069011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.069264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.069363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.069583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.069797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.069797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.069972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.070049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.070276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.070336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.070471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.070547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070729] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.070856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.070914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.070997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.071111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.071425] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be created. [ 745.089570] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.104388] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.104388] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.104388] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.141409] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.141409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.141575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.141655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.141878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.163448] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 745.327731] env[66131]: INFO networking_nsxv3.common.synchronization [req-f0d20ae0-2e63-4b2b-9ee6-0532f3e55678 req-4c725445-4a4c-4a80-9b82-31133fb69c96 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 745.329286] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 745.330155] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.330155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.593117] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.606683] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.096933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.097126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.097172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.097401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.097524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.097637] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 746.110310] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.134332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.134332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.134332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.134332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.134332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.146529] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 746.614322] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.614614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.614614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.614735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.614821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.614922] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be updated. [ 746.646366] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.646537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.646607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.646823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.647106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.658219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 747.184785] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 747.184932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.486067] env[66131]: INFO networking_nsxv3.common.synchronization [None req-9e11b94c-7496-4c1d-a6fb-124f16d4b2a0 None None] Enqueued Resource ID: 07dddee4-c2e6-4551-bf48-d800fbfcc9a6 with Priority: HIGHEST for action port [ 747.486067] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07dddee4-c2e6-4551-bf48-d800fbfcc9a6 with Priority: HIGHEST for action port [ 747.486067] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-07dddee4-c2e6-4551-bf48-d800fbfcc9a6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.486067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07dddee4-c2e6-4551-bf48-d800fbfcc9a6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.486067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07dddee4-c2e6-4551-bf48-d800fbfcc9a6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.487123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07dddee4-c2e6-4551-bf48-d800fbfcc9a6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.487317] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07dddee4-c2e6-4551-bf48-d800fbfcc9a6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.990519] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07dddee4-c2e6-4551-bf48-d800fbfcc9a6 [ 747.990831] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.990831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.990943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.991158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.991252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.991355] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07dddee4-c2e6-4551-bf48-d800fbfcc9a6 already deleted. [ 747.991438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07dddee4-c2e6-4551-bf48-d800fbfcc9a6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.162809] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 748.163154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.163424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.163576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.163782] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.163896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.163960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.164137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.164225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.164320] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.667394] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.667598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.667678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.667912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.668043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.668221] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.668380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.668502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.668610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.668687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.668768] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 748.672319] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.672319] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.672319] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.704507] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.704739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.704864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.705111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.705316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.717775] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 749.176098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.176098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.176098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.176098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.177213] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.177541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.177692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.177886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.178057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.178239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.178445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.681635] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9664a1c4-6b34-480a-af3f-b95cb52e088f: rpc.has_security_group_logging(os_id): False [ 749.701440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.701440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.701696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.701748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.701870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.704103] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.704858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.704858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.705273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.705396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.705620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.706273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.706273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.706273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.706273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.706273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.706273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.706701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.706701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.706701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.706701] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be updated. [ 749.788055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.788198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.788263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.788478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.788621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.805496] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 749.905029] env[66131]: INFO networking_nsxv3.common.synchronization [None req-c18a9574-53eb-45a7-9502-b509910f07e7 None None] Enqueued Resource ID: 1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a with Priority: HIGHEST for action port [ 749.905707] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a with Priority: HIGHEST for action port [ 749.906454] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.906603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.906707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.907043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.907167] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.213418] env[66131]: INFO networking_nsxv3.common.synchronization [req-fa959e8e-5dec-46dd-b26c-c01cc926f5e2 req-76929b03-ae94-427c-9f48-1fa02de48d55 tempest-InstanceActionsV221TestJSON-538750641 tempest-InstanceActionsV221TestJSON-538750641-project-member] Enqueued Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_members [ 750.213977] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGHEST for action security_group_members [ 750.214409] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.214409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.214549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.214668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.215080] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.215080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.215080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.215240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.215328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.215503] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.410281] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a [ 750.410530] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.410665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.410738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.410946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.411050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.411145] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a already deleted. [ 750.411229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1567e35e-41a5-4d4e-92a7-5b8f56f0cc1a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.719863] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.721129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.721229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.721540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.721674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.721935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.722113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.722181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.722405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.722522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.722601] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 is going to be updated. [ 750.729680] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 750.730276] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 deletion is rescheduled due to dependency. [ 750.730501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.730787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.731126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.731530] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.732212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.732212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.732212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.732212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.733718] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.783543] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.783707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.784018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.784628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.784820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.798592] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 in Status: IN_PROGRESS for 2s [ 751.238704] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.239170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.239170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.239170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.239337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.239465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.239571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.239625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.239780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.239858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.239976] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 751.270575] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.270736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.270806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.271044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.271200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.284320] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 751.823896] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 751.824263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.394163] env[66131]: INFO networking_nsxv3.common.synchronization [None req-3914335a-8b42-4b3a-ad3a-cd55188f9530 None None] Enqueued Resource ID: 1654e285-9bfa-4bac-80be-9da7668524c0 with Priority: HIGHEST for action port [ 752.394854] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1654e285-9bfa-4bac-80be-9da7668524c0 with Priority: HIGHEST for action port [ 752.394943] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1654e285-9bfa-4bac-80be-9da7668524c0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.395027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1654e285-9bfa-4bac-80be-9da7668524c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.396075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1654e285-9bfa-4bac-80be-9da7668524c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.396075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1654e285-9bfa-4bac-80be-9da7668524c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.396075] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1654e285-9bfa-4bac-80be-9da7668524c0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.810899] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 in Status: SUCCESS [ 752.811077] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 deletion is rescheduled due to dependency. [ 752.811204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.894057] env[66131]: INFO networking_nsxv3.common.synchronization [req-58babcbe-98e2-422c-81e1-f9e0b635e0bf req-f5b37bea-d4e0-4847-904b-8d2c4d2227b6 tempest-ServerTagsTestJSON-227607127 tempest-ServerTagsTestJSON-227607127-project-member] Enqueued Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_members [ 752.894057] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_members [ 752.894057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.894057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.894057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.894057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.894057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.894057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.894057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.894057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.894713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.894713] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.898671] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1654e285-9bfa-4bac-80be-9da7668524c0 [ 752.898671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.899236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.899236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.899482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.899602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.899707] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1654e285-9bfa-4bac-80be-9da7668524c0 already deleted. [ 752.899811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1654e285-9bfa-4bac-80be-9da7668524c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.298443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 753.298443] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 deletion is rescheduled due to dependency. [ 753.298443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.396887] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.397371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.397371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.397371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.397608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.397608] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.397750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.397813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.401022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.401022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.401022] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a already deleted. [ 753.401022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.412408] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.412605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-470" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.412741] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-470" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.413169] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-470" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.413512] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.414491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.414491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.414491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.414491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.414698] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.414817] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.414991] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.415238] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.415404] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.415575] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.415726] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.438064] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.438260] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.438521] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.438615] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-470" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.439140] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-775a7c26-2032-4058-99ef-a7de4690d631 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.440413] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.440566] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.440925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.441514] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775a7c26-2032-4058-99ef-a7de4690d631',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.946661] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.948479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.948479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.948479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.948479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.948479] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 775a7c26-2032-4058-99ef-a7de4690d631 not found, creating... [ 753.948479] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.948479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.948479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.949734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.949734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.949799] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.949915] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.950652] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.950923] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.951495] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.951495] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 775a7c26-2032-4058-99ef-a7de4690d631 is going to be created. [ 753.978656] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.979885] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.979960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.980368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.980844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.981139] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.385747] env[66131]: INFO networking_nsxv3.common.synchronization [req-e386d58e-bbe2-4ddf-9e77-83e6ccc99a9a req-ec394dc3-e436-4956-908e-4cd236115026 tempest-ServersAdminNegativeTestJSON-1386696782 tempest-ServersAdminNegativeTestJSON-1386696782-project-member] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 754.386367] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 754.386680] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.386837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.386920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.387978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.388194] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.388391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.390607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.390826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.390921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.391063] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.680532] env[66131]: INFO networking_nsxv3.common.synchronization [req-9e416211-ae84-485a-a718-1907be5ea7fb req-2ba3f5f7-b789-4109-80ef-f087dd5747a2 tempest-SecurityGroupRulesNegativeTestJSON-282768626 tempest-SecurityGroupRulesNegativeTestJSON-282768626-project-member] Enqueued Resource ID: 1b3e7521-fd28-4180-8512-9acda72cb054 with Priority: HIGHEST for action security_group_rules [ 754.681336] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3e7521-fd28-4180-8512-9acda72cb054 with Priority: HIGHEST for action security_group_rules [ 754.681459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b3e7521-fd28-4180-8512-9acda72cb054 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.681576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.681643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.681891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.681974] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b3e7521-fd28-4180-8512-9acda72cb054',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.778408] env[66131]: INFO networking_nsxv3.common.synchronization [req-58babcbe-98e2-422c-81e1-f9e0b635e0bf req-c0d3ea51-2c73-4d62-a82a-7539f5175e7d service nova] Enqueued Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_rules [ 754.778408] env[66131]: INFO networking_nsxv3.common.synchronization [req-58babcbe-98e2-422c-81e1-f9e0b635e0bf req-c0d3ea51-2c73-4d62-a82a-7539f5175e7d service nova] Enqueued Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_members [ 754.778408] env[66131]: INFO networking_nsxv3.common.synchronization [req-58babcbe-98e2-422c-81e1-f9e0b635e0bf req-c0d3ea51-2c73-4d62-a82a-7539f5175e7d service nova] Enqueued Resource ID: 775a7c26-2032-4058-99ef-a7de4690d631 with Priority: HIGHEST for action port [ 754.778408] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_rules [ 754.778727] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_members [ 754.778727] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775a7c26-2032-4058-99ef-a7de4690d631 with Priority: HIGHEST for action port [ 754.778891] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.778985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.779113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.779326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.779413] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.781226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.781226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.781226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.781401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.781401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.781480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.781532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.781675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.781763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.781859] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.782897] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-775a7c26-2032-4058-99ef-a7de4690d631 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.782897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.782897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.783129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.783129] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775a7c26-2032-4058-99ef-a7de4690d631',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.896848] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.207607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.207837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.207935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.208198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.208300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.208405] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b3e7521-fd28-4180-8512-9acda72cb054 already deleted. [ 755.208516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.281630] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.282646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.286636] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.287684] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 775a7c26-2032-4058-99ef-a7de4690d631 with status ACTIVE [ 755.288957] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.290092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.290092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.290452] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.290452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.290452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.290628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.290628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.290708] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 775a7c26-2032-4058-99ef-a7de4690d631 is going to be updated. [ 755.317938] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.317938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.317938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.318237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.318347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.319038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-775a7c26-2032-4058-99ef-a7de4690d631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.403246] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.701760] env[66131]: INFO networking_nsxv3.common.synchronization [req-84c4fc3a-1618-43c4-b305-7c749d486f22 req-dbce4cd6-d9a1-4423-98bf-0d3acaeb7824 tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 755.701760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 755.701760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.701760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.701760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.702612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.702868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.702868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.702984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.703114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.703200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.703291] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.735293] env[66131]: INFO networking_nsxv3.common.synchronization [None req-134ef103-7031-4214-af22-d2b361f5f84f None None] Enqueued Resource ID: 8cf61043-489b-4af8-ac01-9cc03a0bd7a0 with Priority: HIGHEST for action port [ 755.735998] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cf61043-489b-4af8-ac01-9cc03a0bd7a0 with Priority: HIGHEST for action port [ 755.736532] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cf61043-489b-4af8-ac01-9cc03a0bd7a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.736860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cf61043-489b-4af8-ac01-9cc03a0bd7a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.737645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cf61043-489b-4af8-ac01-9cc03a0bd7a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.738016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cf61043-489b-4af8-ac01-9cc03a0bd7a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.738207] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cf61043-489b-4af8-ac01-9cc03a0bd7a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.795384] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.905766] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.905916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.906522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.906522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.906522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.908039] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be updated. [ 755.942938] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.942938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.943945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.943945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.943945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.959396] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: IN_PROGRESS for 2s [ 756.207132] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.208049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.208049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.208049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.208049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.208049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.208049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.208049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.208540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.208540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.208540] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 756.215506] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.216285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.216285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.217165] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.217403] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.217737] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.217985] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.218335] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.219396] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.219396] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.219396] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.219396] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.219396] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.219396] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.219396] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.220451] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.240713] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.240713] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.240850] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.240946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.241291] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.241464] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.241571] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.242127] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.242491] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a54a5b00-6c10-4486-9dd8-b2cb1563e65c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.243462] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cf61043-489b-4af8-ac01-9cc03a0bd7a0 [ 756.243735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.243896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.243964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.244267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.244423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.245171] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cf61043-489b-4af8-ac01-9cc03a0bd7a0 already deleted. [ 756.245171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cf61043-489b-4af8-ac01-9cc03a0bd7a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.245856] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.245950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.246022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.247055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.247338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.260820] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 756.296928] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.297732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.297826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.298096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.298197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.298304] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a is going to be created. [ 756.333851] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.334086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.334194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.334621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.334621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.346653] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a in Status: UNINITIALIZED for 2s [ 756.750183] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.750542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.750542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.750809] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.750950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.751124] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port a54a5b00-6c10-4486-9dd8-b2cb1563e65c not found, creating... [ 756.751403] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.751677] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.751788] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.752057] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.752252] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.752824] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.753168] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.753325] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.753594] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.753741] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.753879] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: a54a5b00-6c10-4486-9dd8-b2cb1563e65c is going to be created. [ 756.777189] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.778122] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.778122] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.778408] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.778728] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.779169] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.102780] env[66131]: INFO networking_nsxv3.common.synchronization [req-6134482c-45e9-46a9-aaef-195e4e9c8722 req-462485b0-0224-43b1-a9c9-56832e16bc71 tempest-SecurityGroupRulesNegativeTestJSON-282768626 tempest-SecurityGroupRulesNegativeTestJSON-282768626-project-member] Enqueued Resource ID: 1b3e7521-fd28-4180-8512-9acda72cb054 with Priority: HIGHEST for action security_group_rules [ 757.104408] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3e7521-fd28-4180-8512-9acda72cb054 with Priority: HIGHEST for action security_group_rules [ 757.104408] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b3e7521-fd28-4180-8512-9acda72cb054 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.104408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.104408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.104877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.105859] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b3e7521-fd28-4180-8512-9acda72cb054',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.633376] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.633571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.633662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.633889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.634216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.634216] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b3e7521-fd28-4180-8512-9acda72cb054 already deleted. [ 757.634216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b3e7521-fd28-4180-8512-9acda72cb054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.644679] env[66131]: INFO networking_nsxv3.common.synchronization [req-84c4fc3a-1618-43c4-b305-7c749d486f22 req-68f18bb8-ecd2-479d-9c82-5a43f33c82b6 service nova] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_rules [ 757.644809] env[66131]: INFO networking_nsxv3.common.synchronization [req-84c4fc3a-1618-43c4-b305-7c749d486f22 req-68f18bb8-ecd2-479d-9c82-5a43f33c82b6 service nova] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 757.644943] env[66131]: INFO networking_nsxv3.common.synchronization [req-84c4fc3a-1618-43c4-b305-7c749d486f22 req-68f18bb8-ecd2-479d-9c82-5a43f33c82b6 service nova] Enqueued Resource ID: a54a5b00-6c10-4486-9dd8-b2cb1563e65c with Priority: HIGHEST for action port [ 757.645799] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_rules [ 757.645992] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 757.646048] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a54a5b00-6c10-4486-9dd8-b2cb1563e65c with Priority: HIGHEST for action port [ 757.646324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.646444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.646513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.646731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.646794] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.647714] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.648540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.648778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.648894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.648961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.649171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.649261] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a54a5b00-6c10-4486-9dd8-b2cb1563e65c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.968196] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 757.968468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.152229] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.152457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.152649] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a54a5b00-6c10-4486-9dd8-b2cb1563e65c with status ACTIVE [ 758.152874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.152995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.153493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.153820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.153923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.154206] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.154393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.154460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.154628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.154720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.154908] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.155017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.155078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.155572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.155700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.155791] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a54a5b00-6c10-4486-9dd8-b2cb1563e65c is going to be updated. [ 758.182569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.182968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.183091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.183327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.183500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.184236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a54a5b00-6c10-4486-9dd8-b2cb1563e65c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.273933] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 758.274209] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 deletion is rescheduled due to dependency. [ 758.274268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.274539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.274760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.274945] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.275081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.275162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.275306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.275401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.275470] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.361027] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a in Status: SUCCESS [ 758.361027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.361027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.361027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.361386] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.361386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.361386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.361498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.361652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.361693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.361753] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.400425] env[66131]: INFO networking_nsxv3.common.synchronization [req-3649a5b0-5db6-48f7-9c85-1c932e2dc9eb req-c3f4fc4c-b9cb-46ca-a749-10a80ac36758 tempest-ServerAddressesNegativeTestJSON-711752863 tempest-ServerAddressesNegativeTestJSON-711752863-project-member] Enqueued Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_members [ 758.403024] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGHEST for action security_group_members [ 758.403024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.403024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.403024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.403024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.403877] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.403877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.403877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.403877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.404206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.404206] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.778970] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.866131] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.869027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.869027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.869027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.869027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.869738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.869738] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.906435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.909277] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.909277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.909277] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b940b435-c759-4394-856d-7ee660b5983d is going to be updated. [ 758.940718] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.940718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.940718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.940718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.940718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.959538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b940b435-c759-4394-856d-7ee660b5983d in Status: IN_PROGRESS for 2s [ 759.282470] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.374978] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a: rpc.has_security_group_logging(os_id): False [ 759.398424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.398570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.398694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.399362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.399362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.399362] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.399362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.399797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.399797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.399797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.399949] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.400054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.400127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.400312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.400384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.400675] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.400675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.400820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.400870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.400918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.401056] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a is going to be created. [ 759.471948] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.472178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.472228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.475652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.475652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.495354] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a in Status: IN_PROGRESS for 2s [ 759.786107] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.786322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.786404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.786633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.786726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.786827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 759.832677] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.832832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.833444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.833444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.833444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.845120] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 760.971792] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b940b435-c759-4394-856d-7ee660b5983d in Status: SUCCESS [ 760.972818] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b940b435-c759-4394-856d-7ee660b5983d deletion is rescheduled due to dependency. [ 760.973248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.161360] env[66131]: INFO networking_nsxv3.common.synchronization [req-8ddffb4a-b0ed-48c2-8b05-40452be4d599 req-6808de31-d7ae-42cd-a305-f5d7017645de tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 761.161914] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 761.162366] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.162428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.162493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.162784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.162945] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.163305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.163305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.163405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.163457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.163560] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.510268] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a in Status: SUCCESS [ 761.511257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.671095] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.671095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.671095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.671363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.671363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.671576] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.671576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.671777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.671777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.671842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.671907] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 761.720378] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.720558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.720697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.720868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.721149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.738145] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 761.856833] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 761.857126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.857312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.857547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.857747] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.857868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.857952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.858270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.858270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.858335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.858392] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.361434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.361434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.361434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.362516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.362516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.362516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.362516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.362516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.362516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.362747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.362935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.363103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.363179] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.363349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.363504] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.363658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.363756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.363959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.365045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.365045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.365045] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.867259] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395c7bb1-0365-458d-a01e-64a431cc84a0: rpc.has_security_group_logging(os_id): False [ 762.889789] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.889789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.889789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.889789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.890149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.890237] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.890337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.890403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.890581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.890660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.892052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.892052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.892052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.892052] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 762.971562] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.971562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.971562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.971562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.971562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.989533] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 763.600030] env[66131]: INFO networking_nsxv3.common.synchronization [req-8117568a-8c98-443f-b9ab-e5f197eca4b3 req-68b2b0a3-2a77-48b8-998c-7184368cf33d tempest-ServerMetadataNegativeTestJSON-1089276130 tempest-ServerMetadataNegativeTestJSON-1089276130-project-member] Enqueued Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_members [ 763.601397] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 with Priority: HIGHEST for action security_group_members [ 763.601397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d46ac8a-ba3b-4036-8bf0-647896954581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.601397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.601397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.601653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.601853] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.605025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.605025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.605025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.605025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.605025] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d46ac8a-ba3b-4036-8bf0-647896954581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.753192] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 763.753192] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 763.753192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.105960] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.105960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.105960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.105960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.105960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.105960] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.106356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.106356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.106356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.106442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.107030] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 is going to be updated. [ 764.135703] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.135856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.135930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.136178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.136321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.150822] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 in Status: IN_PROGRESS for 2s [ 765.009735] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 765.010093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.446377] env[66131]: INFO networking_nsxv3.common.synchronization [req-9ae5d1e8-3ca0-4c45-8c75-c53efef2a53e req-792d2b61-975d-46d4-b065-d87402ed6eb2 tempest-ServersWithSpecificFlavorTestJSON-1087626551 tempest-ServersWithSpecificFlavorTestJSON-1087626551-project-member] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 765.446622] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 765.446998] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.447130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.447250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.447815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.447815] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.447815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.447815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.447967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.447967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.448953] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.766278] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:0 completed [ 765.766278] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:1 started [ 765.950931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.951173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.951242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.951527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.951687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.951817] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.951912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.951970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.953075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.953075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.953075] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be updated. [ 765.989417] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.989417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.989417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.989683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.990191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.001743] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: IN_PROGRESS for 2s [ 766.163262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 in Status: SUCCESS [ 766.163534] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d46ac8a-ba3b-4036-8bf0-647896954581 deletion is rescheduled due to dependency. [ 766.163637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d46ac8a-ba3b-4036-8bf0-647896954581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.015178] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 768.015490] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f deletion is rescheduled due to dependency. [ 768.015490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.447428] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 770.447777] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 771.555429] env[66131]: INFO networking_nsxv3.common.synchronization [None req-c2ea1f5c-90ce-4499-8d68-cd79e205e179 None None] Enqueued Resource ID: 470f913d-7e4d-452f-b88e-a3bff9a29b6d with Priority: HIGHEST for action port [ 771.555726] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 470f913d-7e4d-452f-b88e-a3bff9a29b6d with Priority: HIGHEST for action port [ 771.556315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-470f913d-7e4d-452f-b88e-a3bff9a29b6d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.556585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-470f913d-7e4d-452f-b88e-a3bff9a29b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.556585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-470f913d-7e4d-452f-b88e-a3bff9a29b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.556750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-470f913d-7e4d-452f-b88e-a3bff9a29b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.556831] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('470f913d-7e4d-452f-b88e-a3bff9a29b6d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.960751] env[66131]: INFO networking_nsxv3.common.synchronization [None req-8cb920f6-091c-4cf5-833a-db01ca6c1001 None None] Enqueued Resource ID: 66e0eadf-4cd1-44f1-97eb-65d9858c582c with Priority: HIGHEST for action port [ 771.961804] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66e0eadf-4cd1-44f1-97eb-65d9858c582c with Priority: HIGHEST for action port [ 771.961804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-66e0eadf-4cd1-44f1-97eb-65d9858c582c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.961804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66e0eadf-4cd1-44f1-97eb-65d9858c582c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.961804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66e0eadf-4cd1-44f1-97eb-65d9858c582c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.962044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66e0eadf-4cd1-44f1-97eb-65d9858c582c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.964299] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66e0eadf-4cd1-44f1-97eb-65d9858c582c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.062482] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 470f913d-7e4d-452f-b88e-a3bff9a29b6d [ 772.062891] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.063061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.063405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.063720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.063788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.063909] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:470f913d-7e4d-452f-b88e-a3bff9a29b6d already deleted. [ 772.063973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-470f913d-7e4d-452f-b88e-a3bff9a29b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.468656] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66e0eadf-4cd1-44f1-97eb-65d9858c582c [ 772.469056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.469250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.469351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.469678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.469825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.469970] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66e0eadf-4cd1-44f1-97eb-65d9858c582c already deleted. [ 772.470149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66e0eadf-4cd1-44f1-97eb-65d9858c582c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.222607] env[66131]: INFO networking_nsxv3.common.synchronization [None req-9a647858-6e4c-4259-aa61-217fbcee6463 tempest-ServersTestJSON-564409179 tempest-ServersTestJSON-564409179-project-member] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_rules [ 773.223128] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_rules [ 773.223434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.223557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.223662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.224140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.226219] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.353470] env[66131]: INFO networking_nsxv3.common.synchronization [None req-50dda723-77f1-419b-83ad-509685f2e446 tempest-ServersTestJSON-564409179 tempest-ServersTestJSON-564409179-project-member] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_rules [ 773.354683] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_rules [ 773.354683] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.354683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.752396] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.752583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.752633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.752945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.755752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.757632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 already deleted. [ 773.757632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.757632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.758332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.758332] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.286232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.286232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.286232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.286232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.286232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.286232] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 already deleted. [ 774.286232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.428357] env[66131]: INFO networking_nsxv3.common.synchronization [None req-a22a20be-d96c-4012-be8b-fd97d5db6e09 None None] Enqueued Resource ID: 3a589016-0269-4529-941c-dc51c1c22aad with Priority: HIGHEST for action port [ 774.428923] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a589016-0269-4529-941c-dc51c1c22aad with Priority: HIGHEST for action port [ 774.431443] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a589016-0269-4529-941c-dc51c1c22aad taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.431646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a589016-0269-4529-941c-dc51c1c22aad" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.432307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a589016-0269-4529-941c-dc51c1c22aad" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.432307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a589016-0269-4529-941c-dc51c1c22aad" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.432307] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a589016-0269-4529-941c-dc51c1c22aad',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.936660] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a589016-0269-4529-941c-dc51c1c22aad [ 774.936818] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.936957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.937039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.937258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.937439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.937484] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a589016-0269-4529-941c-dc51c1c22aad already deleted. [ 774.937554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a589016-0269-4529-941c-dc51c1c22aad" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.044332] env[66131]: INFO networking_nsxv3.common.synchronization [None req-bdbffa9f-3a16-4f1f-94fb-4b44aee1d78c None None] Enqueued Resource ID: 0ff3c9da-02ca-4208-a2c0-55c26e35aaf7 with Priority: HIGHEST for action port [ 775.044332] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff3c9da-02ca-4208-a2c0-55c26e35aaf7 with Priority: HIGHEST for action port [ 775.044332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ff3c9da-02ca-4208-a2c0-55c26e35aaf7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.044963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ff3c9da-02ca-4208-a2c0-55c26e35aaf7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ff3c9da-02ca-4208-a2c0-55c26e35aaf7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.045571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ff3c9da-02ca-4208-a2c0-55c26e35aaf7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.045748] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff3c9da-02ca-4208-a2c0-55c26e35aaf7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.548611] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ff3c9da-02ca-4208-a2c0-55c26e35aaf7 [ 775.548871] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.549027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.549091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.549330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.549430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.549536] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ff3c9da-02ca-4208-a2c0-55c26e35aaf7 already deleted. [ 775.549627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ff3c9da-02ca-4208-a2c0-55c26e35aaf7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.547112] env[66131]: INFO networking_nsxv3.common.synchronization [req-5a62cbc1-d422-4754-a88f-5c78bf2161ff req-a955fed1-b246-4fb1-bc9b-68fda38bcd94 tempest-ImagesOneServerTestJSON-1015075785 tempest-ImagesOneServerTestJSON-1015075785-project-member] Enqueued Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_members [ 776.547648] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGHEST for action security_group_members [ 776.547933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.548243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.548328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.549103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.549103] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.549103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.549103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.549103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.549103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.549744] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.053506] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.053506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.053506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.053506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.053506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.053506] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.053506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.053506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.053897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.053897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.053897] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d is going to be updated. [ 777.096167] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.096324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.096324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.096540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.096725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.105812] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d in Status: IN_PROGRESS for 2s [ 777.650797] env[66131]: INFO networking_nsxv3.common.synchronization [req-3aeed9c2-3e71-4ab6-81dc-51fa799fcf80 req-5fdfb383-9f17-4702-a6d9-a934aad832a2 tempest-MigrationsAdminTest-1398354370 tempest-MigrationsAdminTest-1398354370-project-member] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 777.651416] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 777.651723] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.651873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.651920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.652112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.652330] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.652455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.652488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.652652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.653341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.653341] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.039103] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.039385] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.039696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.040029] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.040367] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.040599] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.040832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.040915] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.041051] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.041458] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.041539] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.041616] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.041996] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.041996] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.041996] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.042311] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.067768] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.068055] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.068505] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.068885] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.069312] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.069626] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.069849] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.070404] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.070551] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.156659] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.576168] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.576168] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.576168] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.576168] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.576168] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.576168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd not found, creating... [ 778.576531] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.576531] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.576531] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.576740] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.576831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.577157] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.577262] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.577419] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.577801] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.577993] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.578155] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd is going to be created. [ 778.601193] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.601401] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.601568] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.601723] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.601940] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.602180] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.657897] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.713256] env[66131]: INFO networking_nsxv3.common.synchronization [req-cdbb8a0a-465e-474b-8d8b-8a5b59190322 req-e5948650-2090-4052-94be-8474c1d94a21 tempest-FloatingIPsAssociationTestJSON-1405363732 tempest-FloatingIPsAssociationTestJSON-1405363732-project-member] Enqueued Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 778.714176] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 with Priority: HIGHEST for action security_group_members [ 778.714437] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.714629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.714737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.714977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.715240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.715415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.715521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.715728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.715862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.716088] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2151-bad2-47ce-a462-d37d0b06e5f6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.121347] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d in Status: SUCCESS [ 779.121534] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d deletion is rescheduled due to dependency. [ 779.121651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.161110] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.161357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.161443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.161673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.161767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.161871] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be updated. [ 779.192521] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.192798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.192937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.193232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.193448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.204165] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 779.218936] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.219152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.219230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.219451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.219723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.219795] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.219861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.219900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.220051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.220129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.220888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 is going to be updated. [ 779.262902] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.262902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.262902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.262902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.262902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.282534] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: IN_PROGRESS for 2s [ 779.364139] env[66131]: INFO networking_nsxv3.common.synchronization [req-3aeed9c2-3e71-4ab6-81dc-51fa799fcf80 req-a163edb4-1309-48f4-ab11-dfa21e98dde3 service nova] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_rules [ 779.364411] env[66131]: INFO networking_nsxv3.common.synchronization [req-3aeed9c2-3e71-4ab6-81dc-51fa799fcf80 req-a163edb4-1309-48f4-ab11-dfa21e98dde3 service nova] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 779.364626] env[66131]: INFO networking_nsxv3.common.synchronization [req-3aeed9c2-3e71-4ab6-81dc-51fa799fcf80 req-a163edb4-1309-48f4-ab11-dfa21e98dde3 service nova] Enqueued Resource ID: 0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd with Priority: HIGHEST for action port [ 779.365450] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_rules [ 779.365630] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 779.365630] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd with Priority: HIGHEST for action port [ 779.366081] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.366222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.366474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.366537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.366642] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.368108] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.368242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.369333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.369333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.369333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.369333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.369333] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.872035] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.872035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.873396] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd with status ACTIVE [ 779.873588] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.873709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.873795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.874038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.874139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.874364] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.874436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.874501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.874665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.874746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.874989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.875093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.875093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.875241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.875341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.875428] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd is going to be updated. [ 779.898795] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.899029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.899129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.899459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.899668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.899915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0640d8fb-b2b4-445f-95c6-c4ec01dfe8bd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.992547] env[66131]: INFO networking_nsxv3.common.synchronization [req-abcf00f3-5b68-4e84-b091-7489406e4ed0 req-efed2d12-4250-45c8-85bd-af793f6b720d tempest-ListServerFiltersTestJSON-1463311190 tempest-ListServerFiltersTestJSON-1463311190-project-member] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 779.993723] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 779.993723] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.993723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.993723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.993961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.994134] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.994214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.994214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.994475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.994475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.994608] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.161658] env[66131]: INFO networking_nsxv3.common.synchronization [req-ce209ff5-d0a1-486f-a3d1-9ea8b6895007 req-42ce1d10-3b67-4e7b-b390-e8f3246e558f tempest-ServerTagsTestJSON-227607127 tempest-ServerTagsTestJSON-227607127-project-member] Enqueued Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_members [ 780.162420] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGHEST for action security_group_members [ 780.163393] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.163393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.163393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.163393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.163393] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.163393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.163856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.163856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.163856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.163856] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.430158] env[66131]: INFO networking_nsxv3.common.synchronization [req-b83c0a03-6158-408c-a252-7ce63cec05f8 req-ef1b5193-14be-4f43-8101-e29eb6d6b407 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 780.430158] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 780.430504] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.430651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.430718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.430915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.431092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.431183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.432136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.432136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.432136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.432136] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.500324] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.669933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.670125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.670196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.672075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.672075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.673141] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.673294] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.673392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.673580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.673671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.673766] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a is going to be updated. [ 780.711648] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.711816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.711900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.712102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.712288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.722417] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a in Status: IN_PROGRESS for 2s [ 780.788184] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.788408] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.788408] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.788670] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.789309] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.789582] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.789695] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.789913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.790059] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.791604] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.791604] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.791604] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.791604] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.791604] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.791604] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.791604] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.817647] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.817885] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.818042] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.818223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.818548] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-55dc56f3-84ad-4180-a16d-7bc5e54602e1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.818717] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.818831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.819176] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.819310] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55dc56f3-84ad-4180-a16d-7bc5e54602e1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.937324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.937324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.937324] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 780.969397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.969558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.969641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.969907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.970427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.982883] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 781.007135] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.216271] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 781.216271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.216271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.216271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.216271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.216271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.216271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.216271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.216644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.216644] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.293225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 in Status: SUCCESS [ 781.293499] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2151-bad2-47ce-a462-d37d0b06e5f6 deletion is rescheduled due to dependency. [ 781.293681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2151-bad2-47ce-a462-d37d0b06e5f6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.323038] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.323672] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.323875] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.324279] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.324448] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.324643] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 55dc56f3-84ad-4180-a16d-7bc5e54602e1 not found, creating... [ 781.325024] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.325198] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.325302] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.325597] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.325824] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.326736] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.328202] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.328418] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.328729] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.328898] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.329080] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 55dc56f3-84ad-4180-a16d-7bc5e54602e1 is going to be created. [ 781.333629] env[66131]: INFO networking_nsxv3.common.synchronization [req-eb23c70f-c891-4bc7-9fe6-0f444bb0ace0 req-9040439b-1958-4184-8930-89e81a95570a tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 781.334653] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 781.335013] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.335203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.335311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.335548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.335713] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.335812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.335875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.336072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.336162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.336261] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.357486] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.357911] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.358017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.358352] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.358659] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.358946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.513480] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.513727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.513816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.513977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.514094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.514189] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 781.553343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.553343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.553343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.553343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.553343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.566212] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 781.718920] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.841779] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.841779] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.841779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.841779] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 781.883883] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.884501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.884733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.885042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.885338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.896505] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 782.063814] env[66131]: INFO networking_nsxv3.common.synchronization [req-b83c0a03-6158-408c-a252-7ce63cec05f8 req-99e6f3ad-6c0d-4b52-a271-f53093f3be19 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 782.064178] env[66131]: INFO networking_nsxv3.common.synchronization [req-b83c0a03-6158-408c-a252-7ce63cec05f8 req-99e6f3ad-6c0d-4b52-a271-f53093f3be19 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 782.064178] env[66131]: INFO networking_nsxv3.common.synchronization [req-b83c0a03-6158-408c-a252-7ce63cec05f8 req-99e6f3ad-6c0d-4b52-a271-f53093f3be19 service nova] Enqueued Resource ID: 55dc56f3-84ad-4180-a16d-7bc5e54602e1 with Priority: HIGHEST for action port [ 782.064671] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 782.064811] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 782.064910] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dc56f3-84ad-4180-a16d-7bc5e54602e1 with Priority: HIGHEST for action port [ 782.066109] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.066240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.066311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.066643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.066643] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.067625] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.067625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.067738] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-55dc56f3-84ad-4180-a16d-7bc5e54602e1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.068646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.068646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.068646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.068646] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55dc56f3-84ad-4180-a16d-7bc5e54602e1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.221963] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.570462] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.570462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55dc56f3-84ad-4180-a16d-7bc5e54602e1 with status ACTIVE [ 782.575026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.575026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.575026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.575026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.575026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55dc56f3-84ad-4180-a16d-7bc5e54602e1 is going to be updated. [ 782.610146] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.610281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.610366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.610646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.610794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.611025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55dc56f3-84ad-4180-a16d-7bc5e54602e1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.724869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.725165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.725295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.725612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.725773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.725937] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be updated. [ 782.749223] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a in Status: SUCCESS [ 782.749426] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a deletion is rescheduled due to dependency. [ 782.749533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.767883] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.768056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.768132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.768363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.768528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.780218] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 782.992183] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 782.992434] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 782.992571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.992744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.992949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.993412] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.993592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.993661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.994474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.994596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.994705] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.497329] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.578021] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 783.578316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.908202] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 783.908511] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 deletion is rescheduled due to dependency. [ 783.908511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.001547] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.506427] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.506747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.506747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.509325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.509325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.509325] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 784.542018] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.542018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.542018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.542018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.542018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.554986] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 784.791175] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 784.791292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.791476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.791699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.792516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.792516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.792516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.792516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.792516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.792516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.792516] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.295674] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.295978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.295978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.300224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.300224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.300224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.300224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.300224] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.492152] env[66131]: INFO networking_nsxv3.common.synchronization [req-03b540d2-d673-4c61-baa2-143825bc59ed req-5d40ee1a-4773-4bb1-ba80-04569be72f32 tempest-InstanceActionsNegativeTestJSON-2017971851 tempest-InstanceActionsNegativeTestJSON-2017971851-project-member] Enqueued Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_members [ 785.493015] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_members [ 785.493633] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.494015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.494273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.494740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.495523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.495523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.495523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.495707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.495809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.496025] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.802664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd68ac80-456d-40a6-bada-de320b838ff6: rpc.has_security_group_logging(os_id): False [ 785.823197] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.823457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.823457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.823738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.823738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.823945] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.824111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.824111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.824691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.824691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.824691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.824691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.824691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.824906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.824906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.825251] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.825251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.825251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.825432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.825432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.825538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be updated. [ 785.901473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.901473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.901717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.901775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.901935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.917520] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 785.987398] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.987666] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-457" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.987860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-457" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.988366] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-457" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.988760] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.989021] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.989201] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.989494] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.989700] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.990014] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.990147] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.990522] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.990731] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.990963] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.991106] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.991417] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.000327] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.000691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.000852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.001350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.001776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.002171] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.002594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.002594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.002773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.002914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.003278] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 already deleted. [ 786.003450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.019506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.019709] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.019896] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.020122] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-457" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.020561] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-2e72df94-88c4-4182-8616-6bd3d1d952da taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.020823] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.020855] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.021964] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.021964] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e72df94-88c4-4182-8616-6bd3d1d952da',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.524308] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.524574] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.524742] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.525147] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.525329] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.525520] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 2e72df94-88c4-4182-8616-6bd3d1d952da not found, creating... [ 786.525855] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.526056] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.526178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.526433] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.526569] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.526930] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.527559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.527739] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.528120] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.528348] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.528572] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 2e72df94-88c4-4182-8616-6bd3d1d952da is going to be created. [ 786.556207] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.556641] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.556641] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.556901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.557193] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.557478] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.569078] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 786.569347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.569785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.569785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.570125] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.570335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.570439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.570534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.570618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.570706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.570798] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.073515] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.073921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.073921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.074420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.074550] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.074676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.074742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.074907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.074996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.075107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.075266] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.075363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.075426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.075675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.075764] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.075862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.075956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.076300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.076300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.076511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.076511] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.281171] env[66131]: INFO networking_nsxv3.common.synchronization [req-03b540d2-d673-4c61-baa2-143825bc59ed req-6efc374f-dbbd-4fa8-8183-881e0a889686 service nova] Enqueued Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_rules [ 787.281275] env[66131]: INFO networking_nsxv3.common.synchronization [req-03b540d2-d673-4c61-baa2-143825bc59ed req-6efc374f-dbbd-4fa8-8183-881e0a889686 service nova] Enqueued Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_members [ 787.281479] env[66131]: INFO networking_nsxv3.common.synchronization [req-03b540d2-d673-4c61-baa2-143825bc59ed req-6efc374f-dbbd-4fa8-8183-881e0a889686 service nova] Enqueued Resource ID: 2e72df94-88c4-4182-8616-6bd3d1d952da with Priority: HIGHEST for action port [ 787.282428] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_rules [ 787.282524] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_members [ 787.282657] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e72df94-88c4-4182-8616-6bd3d1d952da with Priority: HIGHEST for action port [ 787.283038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.283197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.283308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.283757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.283852] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.285458] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.285703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.287185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.287185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.287185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.287185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.287185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.287185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.287185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.287185] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.289467] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e72df94-88c4-4182-8616-6bd3d1d952da taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.289467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.289467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.289467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.289467] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e72df94-88c4-4182-8616-6bd3d1d952da',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.580941] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6518e255-8a48-4fe6-8c80-b478b31e143a: rpc.has_security_group_logging(os_id): False [ 787.598074] env[66131]: INFO networking_nsxv3.common.synchronization [req-f44405f3-589c-4956-b5a1-337cc44f7f8f req-9540246b-9d23-45bd-b874-db3f87413af4 tempest-ServersTestBootFromVolume-1636949881 tempest-ServersTestBootFromVolume-1636949881-project-member] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_members [ 787.598074] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGHEST for action security_group_members [ 787.598696] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.599016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.599204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.599511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.599892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.600124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.600299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.600555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.600737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.600933] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.612473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.612473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.612473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.612473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.613268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.613652] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.613941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.614303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.614602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.615299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.615563] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 787.699861] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.700023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.700097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.700502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.701146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.729684] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 787.794300] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.794300] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e72df94-88c4-4182-8616-6bd3d1d952da with status ACTIVE [ 787.794300] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.794300] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.794300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.794300] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.795812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.795812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.797088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.797088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.797088] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e72df94-88c4-4182-8616-6bd3d1d952da is going to be updated. [ 787.798284] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.831698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.831698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.831698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.831698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.831698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.831698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e72df94-88c4-4182-8616-6bd3d1d952da" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.938430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 787.938430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.059303] env[66131]: INFO networking_nsxv3.common.synchronization [None req-d5789e03-3a69-47cf-8840-f59477d28d2d None None] Enqueued Resource ID: 55171634-3f6b-46e0-bb4c-6cba8d820354 with Priority: HIGHEST for action port [ 788.060696] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55171634-3f6b-46e0-bb4c-6cba8d820354 with Priority: HIGHEST for action port [ 788.062779] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-55171634-3f6b-46e0-bb4c-6cba8d820354 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.063686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55171634-3f6b-46e0-bb4c-6cba8d820354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.064457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55171634-3f6b-46e0-bb4c-6cba8d820354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.064797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55171634-3f6b-46e0-bb4c-6cba8d820354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.064896] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55171634-3f6b-46e0-bb4c-6cba8d820354',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.081382] env[66131]: INFO networking_nsxv3.common.synchronization [req-8d375a3b-c55e-4a77-9c67-c2ae433c4cd5 req-a6912861-7f09-4a48-8bce-57b1f3803f1f tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 788.083520] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 788.084228] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.084406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.084482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.084693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.084882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.084993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.085091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.085225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.085313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.085419] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.103558] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.103786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.103786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.104047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.104047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.104047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.104494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.104494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.104665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.104665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.104750] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 is going to be updated. [ 788.137777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.137952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.137999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.139933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.139933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.153231] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20197510-1697-4884-9af2-fab8e2bd3774 in Status: IN_PROGRESS for 2s [ 788.301588] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.568531] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55171634-3f6b-46e0-bb4c-6cba8d820354 [ 788.568943] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.569892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.573025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.573025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.573025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.573025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55171634-3f6b-46e0-bb4c-6cba8d820354 already deleted. [ 788.573025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55171634-3f6b-46e0-bb4c-6cba8d820354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.588243] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.804440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.804685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.804791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.805019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.805125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.805596] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 is going to be created. [ 788.833614] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.833830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.833944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.834234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.834520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.846645] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 in Status: UNINITIALIZED for 2s [ 789.092098] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.598169] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.598169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.598169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.598169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.598169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.598169] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 789.641772] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.643354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.643354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.643354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.643354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.654994] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 789.749260] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 789.751195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.779297] env[66131]: INFO networking_nsxv3.common.synchronization [None req-047bb4f0-f335-4678-bdd9-c4026daabccb tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 789.779939] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 789.781984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.782150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.782222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.782596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.782710] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.900511] env[66131]: INFO networking_nsxv3.common.synchronization [None req-b76d2a64-e12e-46b3-a6a0-718a3d1c348b tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 789.900511] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 789.901238] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.901238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.165114] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20197510-1697-4884-9af2-fab8e2bd3774 in Status: SUCCESS [ 790.165114] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 deletion is rescheduled due to dependency. [ 790.165114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.323247] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.323247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.323654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.323654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.323654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.323865] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 already deleted. [ 790.323865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.324149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.324360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.324446] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.596319] env[66131]: INFO networking_nsxv3.common.synchronization [None req-289eda65-7872-439b-b58d-2b6c40b6aeb8 None None] Enqueued Resource ID: 14ef4b01-6fef-49b0-91a4-75cd4c70e579 with Priority: HIGHEST for action port [ 790.596319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ef4b01-6fef-49b0-91a4-75cd4c70e579 with Priority: HIGHEST for action port [ 790.596469] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-14ef4b01-6fef-49b0-91a4-75cd4c70e579 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.596530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14ef4b01-6fef-49b0-91a4-75cd4c70e579" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.598773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14ef4b01-6fef-49b0-91a4-75cd4c70e579" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.598773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14ef4b01-6fef-49b0-91a4-75cd4c70e579" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.598773] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14ef4b01-6fef-49b0-91a4-75cd4c70e579',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.849380] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.849699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.849699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.849838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.849893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.849998] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 already deleted. [ 790.850398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.858674] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 in Status: SUCCESS [ 790.858806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.858870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.859067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.859261] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.859448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.859510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.859663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.859935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.859935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.859935] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.100686] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14ef4b01-6fef-49b0-91a4-75cd4c70e579 [ 791.100686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.100686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.100686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.100686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.100686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.100686] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14ef4b01-6fef-49b0-91a4-75cd4c70e579 already deleted. [ 791.100686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14ef4b01-6fef-49b0-91a4-75cd4c70e579" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.362735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.363017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.363017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.363168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.363354] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.363483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.363523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.364285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.364389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.364488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.364673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.364770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.364833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.364981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.365138] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.365230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.365293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.365432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.365508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.365590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.365681] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.665933] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 791.666193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.872545] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05: rpc.has_security_group_logging(os_id): False [ 791.896532] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.897075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.897075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.897184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.897489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.897489] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.897607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.897607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.898171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.898171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.898171] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.899396] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.899396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.899396] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 is going to be created. [ 791.971936] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.972108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.972181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.972500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.972701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.984133] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 in Status: IN_PROGRESS for 2s [ 792.681977] env[66131]: INFO networking_nsxv3.common.synchronization [req-8526c9bc-34a9-4fd1-a19d-d4cfc0fc7455 req-fcad7ad1-34b4-4b89-8189-b2085bff91a5 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 792.683062] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 792.683480] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.683946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.683946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.683946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.684182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.684340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.684440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.684637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.684735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.684831] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.708244] env[66131]: INFO networking_nsxv3.common.synchronization [req-8526c9bc-34a9-4fd1-a19d-d4cfc0fc7455 req-fcad7ad1-34b4-4b89-8189-b2085bff91a5 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 792.708244] env[66131]: INFO networking_nsxv3.common.synchronization [req-8526c9bc-34a9-4fd1-a19d-d4cfc0fc7455 req-fcad7ad1-34b4-4b89-8189-b2085bff91a5 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 792.708244] env[66131]: INFO networking_nsxv3.common.synchronization [req-8526c9bc-34a9-4fd1-a19d-d4cfc0fc7455 req-fcad7ad1-34b4-4b89-8189-b2085bff91a5 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: 60bc7960-c968-4bed-ad23-59c07182722f with Priority: HIGHEST for action port [ 792.709025] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 792.709025] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 792.709025] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60bc7960-c968-4bed-ad23-59c07182722f with Priority: HIGHEST for action port [ 792.709172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.709333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.709426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.709658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.709894] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.710860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.711011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.711250] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-60bc7960-c968-4bed-ad23-59c07182722f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.711453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.711543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.714400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.714400] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60bc7960-c968-4bed-ad23-59c07182722f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.187691] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.217980] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.219130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.219130] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60bc7960-c968-4bed-ad23-59c07182722f with status ACTIVE [ 793.219130] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.219130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.219130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.219512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.219512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.219512] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.219652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.219652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.219774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.219843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.220027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.220144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.220196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.220331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.220435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.220524] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60bc7960-c968-4bed-ad23-59c07182722f is going to be updated. [ 793.246895] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.247177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.247255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.247601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.247767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.248027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.308961] env[66131]: INFO networking_nsxv3.common.synchronization [req-1dc7c52c-db64-4041-bbf7-a38a76f75f2a req-bacc08d2-6d67-4fc5-a53f-943d18ca59c2 tempest-ServerDiagnosticsTest-41696850 tempest-ServerDiagnosticsTest-41696850-project-member] Enqueued Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_members [ 793.309984] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_members [ 793.310283] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.310481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.311101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.311422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.311617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.311741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.311909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.312187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.312303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.312627] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.700098] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.702041] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.702594] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.702594] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.702980] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.702980] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.703134] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.703489] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.703489] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.703645] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.703772] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.703919] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.703962] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.704083] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.704188] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.704284] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.704409] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.734619] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.734619] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.734619] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.734619] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-354" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.734619] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-2ba86474-b6cf-49ec-9337-5c093a0a28ed taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.734619] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.734619] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.734619] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.736185] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba86474-b6cf-49ec-9337-5c093a0a28ed',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.817775] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.817938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.818020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.818252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.818368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.818568] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.818670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.818754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.819079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.819079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.819214] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 already deleted. [ 793.819214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.997456] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 in Status: SUCCESS [ 793.997691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.207819] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.208179] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.208270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.209080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.209080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.209080] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be updated. [ 794.239561] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.240057] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.240409] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.240933] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.241033] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.241310] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 2ba86474-b6cf-49ec-9337-5c093a0a28ed not found, creating... [ 794.241684] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.242219] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.242219] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.242417] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.242905] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.243211] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.244280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.244280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.244280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.244280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.244280] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 2ba86474-b6cf-49ec-9337-5c093a0a28ed is going to be created. [ 794.246430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.246585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.246682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.246980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.247209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.260672] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: IN_PROGRESS for 2s [ 794.269606] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.269892] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.270048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.270475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.270738] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.271090] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.972466] env[66131]: INFO networking_nsxv3.common.synchronization [req-1dc7c52c-db64-4041-bbf7-a38a76f75f2a req-22e9845b-a2d9-4def-ba2e-4df8dca4e05d service nova] Enqueued Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_rules [ 794.972466] env[66131]: INFO networking_nsxv3.common.synchronization [req-1dc7c52c-db64-4041-bbf7-a38a76f75f2a req-22e9845b-a2d9-4def-ba2e-4df8dca4e05d service nova] Enqueued Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_members [ 794.972843] env[66131]: INFO networking_nsxv3.common.synchronization [req-1dc7c52c-db64-4041-bbf7-a38a76f75f2a req-22e9845b-a2d9-4def-ba2e-4df8dca4e05d service nova] Enqueued Resource ID: 2ba86474-b6cf-49ec-9337-5c093a0a28ed with Priority: HIGHEST for action port [ 794.973261] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_rules [ 794.974034] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_members [ 794.974034] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba86474-b6cf-49ec-9337-5c093a0a28ed with Priority: HIGHEST for action port [ 794.974561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.974561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.974561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.974825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.974907] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.975783] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.975948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.976099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.976213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.976523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.976697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.976755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.976910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.976974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.977085] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.977882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba86474-b6cf-49ec-9337-5c093a0a28ed taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.977993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.978074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.978235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.978301] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba86474-b6cf-49ec-9337-5c093a0a28ed',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.480430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ba86474-b6cf-49ec-9337-5c093a0a28ed with status ACTIVE [ 795.480687] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.480839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.480908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.481286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.481409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.481599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.481699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.481765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.481927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.482036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.482217] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.482307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.482370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.482565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.482647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.482750] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ba86474-b6cf-49ec-9337-5c093a0a28ed is going to be updated. [ 795.483972] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.485970] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.485970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.509559] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.509823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.509986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.510175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.510402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.510579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba86474-b6cf-49ec-9337-5c093a0a28ed" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.799465] env[66131]: INFO networking_nsxv3.common.synchronization [req-cb1908c1-f7e5-4657-8059-0932a6860ecd req-517756ab-4a81-417d-8d77-674b7f39282f tempest-ServersNegativeTestJSON-775626346 tempest-ServersNegativeTestJSON-775626346-project-member] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 795.799465] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 795.799675] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.800110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.800110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.800226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.800991] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.800991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.800991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.800991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.800991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.800991] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.991811] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.231939] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.231939] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.231939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.232755] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.232755] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.232755] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.232755] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.232755] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.233061] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.233061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.253348] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.253568] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.253735] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.254221] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.254344] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-c303eefd-fddb-406b-b4ab-74021d247d1e taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.254561] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.254666] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.255149] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.255149] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c303eefd-fddb-406b-b4ab-74021d247d1e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.270055] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: SUCCESS [ 796.270055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.270216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.270932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.272125] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.272125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.272125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.272125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.272125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.272125] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.302910] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.469631] env[66131]: INFO networking_nsxv3.common.synchronization [None req-1fb38eec-6a26-40fc-bfe0-364cf005e4c6 None None] Enqueued Resource ID: b2b60ceb-a6a7-4485-88ac-c8b011cc7c28 with Priority: HIGHEST for action port [ 796.469631] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2b60ceb-a6a7-4485-88ac-c8b011cc7c28 with Priority: HIGHEST for action port [ 796.469631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2b60ceb-a6a7-4485-88ac-c8b011cc7c28 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.469631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2b60ceb-a6a7-4485-88ac-c8b011cc7c28" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.469631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2b60ceb-a6a7-4485-88ac-c8b011cc7c28" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.471776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2b60ceb-a6a7-4485-88ac-c8b011cc7c28" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.471776] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b60ceb-a6a7-4485-88ac-c8b011cc7c28',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.490375] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.490786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.492773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.492773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.492773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.492773] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 is going to be created. [ 796.517154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.517154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.517154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.517154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.517154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.530045] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 in Status: UNINITIALIZED for 2s [ 796.758442] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.758670] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.758790] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.759086] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.759230] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.759377] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port c303eefd-fddb-406b-b4ab-74021d247d1e not found, creating... [ 796.759623] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.759775] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.759883] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.760109] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.760242] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.760510] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.760895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.760895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.760963] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.761089] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.761224] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: c303eefd-fddb-406b-b4ab-74021d247d1e is going to be created. [ 796.774988] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.780799] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.780799] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.780799] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.780986] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.781340] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.781519] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.805686] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.973429] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2b60ceb-a6a7-4485-88ac-c8b011cc7c28 [ 796.973907] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.976036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.976036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.976036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.976036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.976036] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2b60ceb-a6a7-4485-88ac-c8b011cc7c28 already deleted. [ 796.976036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2b60ceb-a6a7-4485-88ac-c8b011cc7c28" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.277093] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.311312] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.313038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.313038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.313038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.313038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.313038] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 797.352806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.352951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.353040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.353259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.353429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.365946] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 797.592418] env[66131]: INFO networking_nsxv3.common.synchronization [req-cb1908c1-f7e5-4657-8059-0932a6860ecd req-4a7dbe66-edba-42c1-adff-8b612419043c service nova] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_rules [ 797.592647] env[66131]: INFO networking_nsxv3.common.synchronization [req-cb1908c1-f7e5-4657-8059-0932a6860ecd req-4a7dbe66-edba-42c1-adff-8b612419043c service nova] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 797.592824] env[66131]: INFO networking_nsxv3.common.synchronization [req-cb1908c1-f7e5-4657-8059-0932a6860ecd req-4a7dbe66-edba-42c1-adff-8b612419043c service nova] Enqueued Resource ID: c303eefd-fddb-406b-b4ab-74021d247d1e with Priority: HIGHEST for action port [ 797.593943] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_rules [ 797.594087] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 797.594248] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c303eefd-fddb-406b-b4ab-74021d247d1e with Priority: HIGHEST for action port [ 797.596026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.596026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.596026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.596026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.596026] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.600027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.600027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.600027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c303eefd-fddb-406b-b4ab-74021d247d1e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.600273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.600273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.600587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.600697] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c303eefd-fddb-406b-b4ab-74021d247d1e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.782825] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.782825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.782825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.782825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.782825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.782825] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be updated. [ 797.819455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.819700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.819700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.819947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.820162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.834180] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: IN_PROGRESS for 2s [ 798.100360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.100615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.103301] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c303eefd-fddb-406b-b4ab-74021d247d1e with status ACTIVE [ 798.107115] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.107115] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.107115] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.107115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.107115] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c303eefd-fddb-406b-b4ab-74021d247d1e is going to be updated. [ 798.128893] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.129064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.129136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.129349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.129486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.129649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c303eefd-fddb-406b-b4ab-74021d247d1e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.171609] env[66131]: INFO networking_nsxv3.common.synchronization [req-64ff5a51-9918-4ccf-9e1c-df99aa2bd3cd req-8789f11a-462b-4de7-b8a7-12ca736f6612 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 798.172339] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 798.172807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.172971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.195025] env[66131]: INFO networking_nsxv3.common.synchronization [req-64ff5a51-9918-4ccf-9e1c-df99aa2bd3cd req-8789f11a-462b-4de7-b8a7-12ca736f6612 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 798.195025] env[66131]: INFO networking_nsxv3.common.synchronization [req-64ff5a51-9918-4ccf-9e1c-df99aa2bd3cd req-8789f11a-462b-4de7-b8a7-12ca736f6612 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 798.195025] env[66131]: INFO networking_nsxv3.common.synchronization [req-64ff5a51-9918-4ccf-9e1c-df99aa2bd3cd req-8789f11a-462b-4de7-b8a7-12ca736f6612 tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: 60bc7960-c968-4bed-ad23-59c07182722f with Priority: HIGHEST for action port [ 798.195302] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_rules [ 798.195574] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 798.195889] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60bc7960-c968-4bed-ad23-59c07182722f with Priority: HIGHEST for action port [ 798.196422] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.196917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.197451] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.197745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.198122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-60bc7960-c968-4bed-ad23-59c07182722f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.198382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.198625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.199193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.199445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60bc7960-c968-4bed-ad23-59c07182722f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.542370] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 in Status: SUCCESS [ 798.542696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.542899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.543187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.543465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.543608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.543684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.543924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.544048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.544221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.544297] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.703546] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60bc7960-c968-4bed-ad23-59c07182722f with status ACTIVE [ 798.703762] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.703921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.703994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.704217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.704319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.704492] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.704585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.704649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.704897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.704979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.705174] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.705268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.705369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.705484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.705555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.705640] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60bc7960-c968-4bed-ad23-59c07182722f is going to be updated. [ 798.727894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.728128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.728241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.728563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.728773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.729014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60bc7960-c968-4bed-ad23-59c07182722f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.046523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.046811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.046910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.047106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.047273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.047357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.047414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.047556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.047634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.047718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.047855] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.047940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.047996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.048143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.048271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.048356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.048420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.048549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.048620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.048696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.048784] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.084795] env[66131]: INFO networking_nsxv3.common.synchronization [None req-72ba746f-721f-49b6-b7e8-c714cc9ffc7d None None] Enqueued Resource ID: ad6e8fcb-eaa6-4613-90db-d0985b431ac7 with Priority: HIGHEST for action port [ 799.084795] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad6e8fcb-eaa6-4613-90db-d0985b431ac7 with Priority: HIGHEST for action port [ 799.084795] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad6e8fcb-eaa6-4613-90db-d0985b431ac7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.084795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad6e8fcb-eaa6-4613-90db-d0985b431ac7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.084795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad6e8fcb-eaa6-4613-90db-d0985b431ac7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.085449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad6e8fcb-eaa6-4613-90db-d0985b431ac7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.087048] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad6e8fcb-eaa6-4613-90db-d0985b431ac7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.375856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 799.376100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.376274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.376488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.376674] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.376793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.376859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.377040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.377106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.377202] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.553349] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f4e511e-ecb4-4925-bb07-ae0e14be7969: rpc.has_security_group_logging(os_id): False [ 799.572968] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.572968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.573157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.573283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.573368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.573597] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.573698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.573698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.573838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.573917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.574126] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.574223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.574286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.574422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.574496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.574673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.574775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.574829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.574938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.575024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.575111] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 is going to be created. [ 799.588913] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad6e8fcb-eaa6-4613-90db-d0985b431ac7 [ 799.589221] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.589342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.589415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.589654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.589779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.589779] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad6e8fcb-eaa6-4613-90db-d0985b431ac7 already deleted. [ 799.589864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad6e8fcb-eaa6-4613-90db-d0985b431ac7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.638444] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.638577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.638662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.638851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.639044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.651477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 in Status: IN_PROGRESS for 2s [ 799.845782] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: SUCCESS [ 799.846016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.846207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.846451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.846618] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.846728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.846810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.846964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.847073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.847164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.847259] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.848184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.848358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.848544] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.848639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.848694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.848847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.848927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.849048] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.879557] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.351281] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.352311] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.382169] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.854373] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9ea0bc7-effb-4d5e-938c-ccd65bc31173: rpc.has_security_group_logging(os_id): False [ 800.855582] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.876410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.876692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.876692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.877083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.877083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.877339] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.877453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.877519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.877694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.877827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.877977] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be updated. [ 800.884632] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.884842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.884842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.885136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.885136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.885357] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 800.920448] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.920448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.920448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.920448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.920448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.931792] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 800.965835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.966051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.966051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.966276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.966440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.983849] env[66131]: INFO networking_nsxv3.common.synchronization [req-6ac265d7-7a24-409b-a93b-f7317fb83c41 req-d5270d1e-7f47-43cd-9806-867116677637 tempest-ServerMetadataTestJSON-332631190 tempest-ServerMetadataTestJSON-332631190-project-member] Enqueued Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_members [ 800.985032] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: IN_PROGRESS for 2s [ 800.986850] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_members [ 800.986850] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.986850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.986850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.986850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.986850] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.986850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.986850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.986850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.987347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.987347] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.360357] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.360571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.360612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.360807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.360909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.360980] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be updated. [ 801.395871] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.396065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.396116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.396310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.396453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.411209] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: IN_PROGRESS for 2s [ 801.411417] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.411492] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-534" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.411943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-534" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.411943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-534" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.412249] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.412317] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.413026] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.413026] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.413026] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.413026] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.413209] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.413209] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.413270] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.413377] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.413498] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.413628] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.434801] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.435061] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.435207] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.435398] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-534" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.435721] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.435895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.436023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.436330] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.436466] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9417f65d-cbba-412b-ac96-b2e2e9c6c2c5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.489654] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.489830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.489905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.490152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.490245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.490450] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.490555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.490621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.490805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.490887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.490987] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af already deleted. [ 801.491094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.665620] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 in Status: SUCCESS [ 801.667581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.792177] env[66131]: INFO networking_nsxv3.common.synchronization [req-7e0427ac-52fb-4046-b88a-848c6553447e req-8dd93691-ef92-4a9a-b457-40e0f30547dd tempest-ServersAdminNegativeTestJSON-1386696782 tempest-ServersAdminNegativeTestJSON-1386696782-project-member] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 801.794147] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGHEST for action security_group_members [ 801.794147] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.794147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.794147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.794479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.794479] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.794660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.794707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.794912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.795051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.795189] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.939262] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.939693] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.939871] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.940267] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.940540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.940803] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 not found, creating... [ 801.941139] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.941465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.941636] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.941946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.942102] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.942608] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.942844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.943031] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.943393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.943548] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.943973] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 is going to be created. [ 801.966937] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.967265] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.967468] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.967859] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.968258] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.968607] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.219143] env[66131]: INFO networking_nsxv3.common.synchronization [req-26b24bb3-4d12-4185-8fdf-2d0d9b2afce1 req-4bda612f-fa10-42ff-b608-587708eb6232 tempest-InstanceActionsNegativeTestJSON-2017971851 tempest-InstanceActionsNegativeTestJSON-2017971851-project-member] Enqueued Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_members [ 802.219143] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGHEST for action security_group_members [ 802.219852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.220409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.220622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.220929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.221257] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.221503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.221660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.221932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.222165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.222463] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.303161] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.303161] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.303161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.303161] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be updated. [ 802.341364] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.341549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.341549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.341732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.341873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.351077] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: IN_PROGRESS for 2s [ 802.666515] env[66131]: INFO networking_nsxv3.common.synchronization [req-6ac265d7-7a24-409b-a93b-f7317fb83c41 req-4ce947a1-f3f9-43b0-af69-b479e5f5e54d service nova] Enqueued Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_rules [ 802.666515] env[66131]: INFO networking_nsxv3.common.synchronization [req-6ac265d7-7a24-409b-a93b-f7317fb83c41 req-4ce947a1-f3f9-43b0-af69-b479e5f5e54d service nova] Enqueued Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_members [ 802.666515] env[66131]: INFO networking_nsxv3.common.synchronization [req-6ac265d7-7a24-409b-a93b-f7317fb83c41 req-4ce947a1-f3f9-43b0-af69-b479e5f5e54d service nova] Enqueued Resource ID: 9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 with Priority: HIGHEST for action port [ 802.667249] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_rules [ 802.668573] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_members [ 802.668573] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 with Priority: HIGHEST for action port [ 802.668573] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.668573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.668573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.669363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.669556] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.670785] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.672090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.672090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.672090] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.673860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.673860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.673860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.673860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.673860] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9417f65d-cbba-412b-ac96-b2e2e9c6c2c5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.708781] env[66131]: INFO networking_nsxv3.common.synchronization [req-e32287d8-bc81-41d4-a3b7-740cd4536788 req-df40312a-aaa7-4e36-9ad6-52a617e2131c tempest-AttachInterfacesUnderV243Test-533527896 tempest-AttachInterfacesUnderV243Test-533527896-project-member] Enqueued Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 802.708781] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 with Priority: HIGHEST for action security_group_members [ 802.709765] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.709911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.722676] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.722850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.724143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.724143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.724143] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.724801] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.724883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.724921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.725147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.725236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.725605] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.725605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.725605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.725746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.725788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.725865] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 is going to be updated. [ 802.759811] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.760009] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.760940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.760940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.760940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.770110] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 in Status: IN_PROGRESS for 2s [ 802.945497] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 802.945860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.945942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.946345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.946577] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.946725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.946841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.947100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.947222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.947323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.947413] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.002186] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: SUCCESS [ 803.002402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.002699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.002928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.003024] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.176458] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 with status ACTIVE [ 803.176764] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.178937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.178937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.178937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.179610] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9417f65d-cbba-412b-ac96-b2e2e9c6c2c5 is going to be updated. [ 803.180725] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.181942] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.182056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.203542] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.203784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.203878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.204170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.204319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.204488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9417f65d-cbba-412b-ac96-b2e2e9c6c2c5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.228924] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.420372] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 in Status: SUCCESS [ 803.420596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.420839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.421094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.421347] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.421492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.421794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.421794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.422114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.422262] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.450053] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.450204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.450308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.450485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.450649] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.450739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.450868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.450955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.451055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.451170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.451322] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.451508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.451508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.451636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.451734] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.451851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.451898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.452027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.452110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.452190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.452280] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.527750] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.528096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.530016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.530016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.530016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.530016] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be deleted. [ 803.590740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.590740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.590740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.590740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.590740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.590740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.684917] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.732163] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.869459] env[66131]: INFO networking_nsxv3.common.synchronization [req-8dcbeaa5-4800-4d31-bf8f-02322cb2deaf req-e33a1aac-c29f-4742-b75a-e3e5a68510d9 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 803.869459] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 803.869459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.869459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.869459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.869459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.869459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.869459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.869459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.870465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.871088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.871088] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.925260] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.925404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.925481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.925687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.925776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.925964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.926057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.926393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.926393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.926393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.926560] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 is going to be deleted. [ 803.954366] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f85143-50cb-4ea4-b72b-837126da5251: rpc.has_security_group_logging(os_id): False [ 803.983763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.983850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.984029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.984223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.984393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.984738] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.984930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.985025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.985275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.985377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.985599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.985833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.985903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.988366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.988366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.989642] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.991426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.991426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.991426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.991426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.991426] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 804.002801] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.003166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.003166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.003258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.003304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.003408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.004155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.004155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.004155] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.004155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.004155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.004155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.004402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.004402] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ea0bc7-effb-4d5e-938c-ccd65bc31173',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.061847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.061847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.061847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.064778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.064778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.086663] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 804.188228] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.188941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.189032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.189253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.189343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.189526] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af is going to be created. [ 804.222371] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.222604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.222683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.222892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.223088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.234360] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: UNINITIALIZED for 2s [ 804.234629] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 804.234750] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 804.258241] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.258507] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.258568] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.258824] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.259104] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.259312] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.259436] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.259642] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.259776] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.259975] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.260106] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.260192] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.260294] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.260395] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.260511] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.260646] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.314297] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.314422] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.314461] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.314659] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-588" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.315020] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-e9887383-fb19-42f5-a0cc-f978dbd0207c taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.315216] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.315333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.315653] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.315796] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9887383-fb19-42f5-a0cc-f978dbd0207c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.371117] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0923c94e-4f06-4310-bba9-cc69436848ce in Status: SUCCESS [ 804.371360] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce deletion is rescheduled due to dependency. [ 804.371561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.374595] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.508105] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.508378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.508573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.508924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.509048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.509279] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.509404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.509503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.509716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.509853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.510099] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ea0bc7-effb-4d5e-938c-ccd65bc31173 already deleted. [ 804.510099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ea0bc7-effb-4d5e-938c-ccd65bc31173" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.792696] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 in Status: SUCCESS [ 804.793091] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 deletion is rescheduled due to dependency. [ 804.793321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.819633] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.820027] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.820027] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.820296] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.820516] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.820724] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port e9887383-fb19-42f5-a0cc-f978dbd0207c not found, creating... [ 804.820974] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.821124] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.821276] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.821426] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.821570] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.821849] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.821996] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.822117] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.822324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.822477] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.822625] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: e9887383-fb19-42f5-a0cc-f978dbd0207c is going to be created. [ 804.871942] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.872196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.872280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.872570] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.872809] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.873042] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.877554] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.380520] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.381051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.381143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.381351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.381457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.381542] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 805.441309] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.441309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.441309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.441571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.441679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.447957] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.448131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.448199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.448372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.615204] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 805.616048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.617012] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 805.618740] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 805.620831] env[66131]: INFO networking_nsxv3.common.synchronization [req-8dcbeaa5-4800-4d31-bf8f-02322cb2deaf req-ca8798f5-14b1-4850-b1d7-af45761086c1 service nova] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 805.620988] env[66131]: INFO networking_nsxv3.common.synchronization [req-8dcbeaa5-4800-4d31-bf8f-02322cb2deaf req-ca8798f5-14b1-4850-b1d7-af45761086c1 service nova] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 805.621130] env[66131]: INFO networking_nsxv3.common.synchronization [req-8dcbeaa5-4800-4d31-bf8f-02322cb2deaf req-ca8798f5-14b1-4850-b1d7-af45761086c1 service nova] Enqueued Resource ID: e9887383-fb19-42f5-a0cc-f978dbd0207c with Priority: HIGHEST for action port [ 805.621616] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 805.621751] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 805.621845] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9887383-fb19-42f5-a0cc-f978dbd0207c with Priority: HIGHEST for action port [ 805.622126] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.622307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.622307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.622519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.622594] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.623511] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.623814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.623814] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9887383-fb19-42f5-a0cc-f978dbd0207c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.623953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.624024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.624215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.624310] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9887383-fb19-42f5-a0cc-f978dbd0207c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.656395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.656652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.656652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.656829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.665395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.665994] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 805.666136] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 805.666210] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 805.705350] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.705665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.705665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.705809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.708413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.708413] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 805.774909] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.775137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.775137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.775340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.775560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.775765] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 805.851999] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.852215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.852345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.852711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.853092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.853528] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 805.853641] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cd68ac80-456d-40a6-bada-de320b838ff6', '68b0c3cc-e225-461c-b4fa-14cf951098f5', '1748825f-41ff-4cb0-8413-0bbb18bc3793', '6e016bdc-1186-4d65-a6a4-b589ea567689', 'fc4e8c15-6df2-42fb-824c-bb556c5b499a', '5a1ceaf1-c0bf-46d2-84a1-4263d547ce05', '6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d', 'b094a3d7-f106-4b6e-99e8-eb21f21b3609', '20197510-1697-4884-9af2-fab8e2bd3774', '9664a1c4-6b34-480a-af3f-b95cb52e088f', '40da76d9-e82a-4df1-a543-dfbd1d154789', 'd6f876b0-0618-417d-b11e-0e430c4a1630', '9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a', '1f4e511e-ecb4-4925-bb07-ae0e14be7969', '0923c94e-4f06-4310-bba9-cc69436848ce', '1a60c2e7-c063-4bbc-be63-e2c41ed90972', 'b940b435-c759-4394-856d-7ee660b5983d', 'ad174bf4-cd31-47d0-b677-2a143083800a', '69f85143-50cb-4ea4-b72b-837126da5251', '6518e255-8a48-4fe6-8c80-b478b31e143a', '0f3bfadc-ee4e-4dd7-a668-86025968cc1f', '87932d1b-2e10-4f4e-b38c-90b3b495ce14', '395c7bb1-0365-458d-a01e-64a431cc84a0', '2d46ac8a-ba3b-4036-8bf0-647896954581', '8c5da787-634a-44a5-9a16-ff46306549cf', 'ef5c2151-bad2-47ce-a462-d37d0b06e5f6', '88c2f217-48ed-4b9b-b2f8-5e8fec9e586d', 'a7fc9052-f286-4d53-8d9d-b976649d992e', '1c204a4b-a669-4fe4-b5e6-edacdb0d1270', '091418bc-6d4e-4be2-bfdc-783bb4e9e92b', '019f05d6-48e0-4ee7-bcb4-af4a1a2925af', '3affe7d0-eaa2-49d5-be04-f70f6d573297', 'f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a', '4320e0f3-4bbc-42b2-999c-7e766e099226', '3724e928-c7a7-4c1d-a230-ec565cc9eb94'} {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 805.854132] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 805.875931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.876183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.876183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.876370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.876460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.876607] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 805.876689] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 805.877724] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 805.947645] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.947881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.947881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.948400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.949137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.949356] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 805.949440] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 805.949503] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 805.949558] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 805.949627] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 805.949688] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGH for action security_group_rules [ 805.949764] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGH for action security_group_rules [ 805.949824] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGH for action security_group_rules [ 805.949882] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGH for action security_group_rules [ 805.949938] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGH for action security_group_rules [ 805.949996] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGH for action security_group_rules [ 805.950719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGH for action security_group_rules [ 805.951394] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGH for action security_group_rules [ 805.951394] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGH for action security_group_rules [ 805.951394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.101958] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 806.102235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.126541] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.126541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.128032] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9887383-fb19-42f5-a0cc-f978dbd0207c with status ACTIVE [ 806.128032] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.128215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.128215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.129987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.129987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.129987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.129987] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9887383-fb19-42f5-a0cc-f978dbd0207c is going to be updated. [ 806.161267] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.161565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.161565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.161687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.161787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.161942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.251441] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: UNINITIALIZED for 4s [ 807.629130] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 807.629462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.629509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.630378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.630378] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.630378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.630378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.630378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.630574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.630574] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.134149] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.263771] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: SUCCESS [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.263771] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.263771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.263771] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.637083] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.768621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.768621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.768621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.768621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.768621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.768621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.768621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.769822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.769822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.769822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.769822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.769822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.769822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.769822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.769822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.770174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.770174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.770174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.770267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.770341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.770406] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.084412] env[66131]: INFO networking_nsxv3.common.synchronization [req-d9894317-5d9e-4851-8f1c-0b485d9a67f3 req-4ef5d6cc-6299-4575-b6ea-d51fe4050654 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 809.090753] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 809.091104] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGH for action security_group_rules [ 809.091277] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 with Priority: HIGH for action security_group_rules [ 809.091277] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d with Priority: HIGH for action security_group_rules [ 809.091441] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0923c94e-4f06-4310-bba9-cc69436848ce with Priority: HIGH for action security_group_rules [ 809.091441] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGH for action security_group_rules [ 809.091538] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGH for action security_group_rules [ 809.091630] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGH for action security_group_rules [ 809.091722] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b940b435-c759-4394-856d-7ee660b5983d with Priority: HIGH for action security_group_rules [ 809.091850] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGH for action security_group_rules [ 809.091991] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 with Priority: HIGH for action security_group_rules [ 809.092103] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a with Priority: HIGH for action security_group_rules [ 809.092194] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGH for action security_group_rules [ 809.092297] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGH for action security_group_rules [ 809.092410] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGH for action security_group_rules [ 809.092543] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20197510-1697-4884-9af2-fab8e2bd3774 with Priority: HIGH for action security_group_rules [ 809.092691] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 with Priority: HIGH for action security_group_rules [ 809.092846] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 with Priority: HIGH for action security_group_rules [ 809.092991] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGH for action security_group_rules [ 809.093113] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 with Priority: HIGH for action security_group_rules [ 809.093380] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGH for action security_group_rules [ 809.093675] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.093675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.093844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.093960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.094163] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.094260] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.094322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.094588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.094588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.094696] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.095935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.096122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.096122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.096441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.096441] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.098658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1748825f-41ff-4cb0-8413-0bbb18bc3793 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.098775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.098828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.100112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.100112] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1748825f-41ff-4cb0-8413-0bbb18bc3793',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.100112] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.100112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.100392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.100392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.100466] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.101660] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0923c94e-4f06-4310-bba9-cc69436848ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.101783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.101838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.101973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.102079] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0923c94e-4f06-4310-bba9-cc69436848ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.105494] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.105494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.105494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.105494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.105494] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.105494] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.105494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.105494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.105494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.105494] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.106048] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.106146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.106916] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b940b435-c759-4394-856d-7ee660b5983d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.106916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.106916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.106916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.106916] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b940b435-c759-4394-856d-7ee660b5983d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.108473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.108473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.108473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.108473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.108473] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.108911] env[66131]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 809.109360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.109486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.109526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.109676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.109771] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a60c2e7-c063-4bbc-be63-e2c41ed90972',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.110616] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.110728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.110786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.110949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.111191] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.111893] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.112217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.112217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.112217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.112335] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.113380] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.113380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.113533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.113602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.113688] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.114642] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.114758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.114758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.114907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.114980] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.115878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20197510-1697-4884-9af2-fab8e2bd3774 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.115987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.115987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.116343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.116343] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20197510-1697-4884-9af2-fab8e2bd3774',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.117190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.117437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.117437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.117574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.117910] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a1ceaf1-c0bf-46d2-84a1-4263d547ce05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.118452] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.118566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.118639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.118821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.119011] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b094a3d7-f106-4b6e-99e8-eb21f21b3609',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.119765] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.119866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.119954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.120102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.120173] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.121245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b0c3cc-e225-461c-b4fa-14cf951098f5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.121245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.121342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.121602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.121602] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b0c3cc-e225-461c-b4fa-14cf951098f5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.121816] env[66131]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 809.122548] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.122654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.122705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.122828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.122930] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.141419] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.141419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.141419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.141419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.141419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.141419] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 809.184046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.184046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.184046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.184046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.184046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.194586] env[66131]: INFO networking_nsxv3.common.synchronization [req-6699ba7c-e25d-4ba2-82e7-f265e43c6a7c req-5f934792-4ae9-4e6c-8761-8a12b3f9d4c7 tempest-ServerDiagnosticsTest-41696850 tempest-ServerDiagnosticsTest-41696850-project-member] Enqueued Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_members [ 809.195243] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 with Priority: HIGHEST for action security_group_members [ 809.195539] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f4e511e-ecb4-4925-bb07-ae0e14be7969 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.195803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.195803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.196334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.196334] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.196557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.196557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.197810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.197810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.197810] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f4e511e-ecb4-4925-bb07-ae0e14be7969',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.200394] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 809.272315] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acdbc051-fd26-4fc2-8ede-29b7d3e743af: rpc.has_security_group_logging(os_id): False [ 809.293887] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.295166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.295166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.295166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.295166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.295166] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.295166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.295166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.295578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.295578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.295909] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.296037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.296107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.296374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.296510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.296745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.296868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.296915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.297061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.297321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.297321] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af is going to be created. [ 809.372851] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.373021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.374278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.374536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.374784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.387838] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: IN_PROGRESS for 2s [ 809.557056] env[66131]: INFO networking_nsxv3.common.synchronization [req-fc2ccdc2-e7b2-440a-81ec-d81a97b0263c req-34cecb01-075a-4330-94ce-2cfa12e06d97 tempest-ServersNegativeTestJSON-775626346 tempest-ServersNegativeTestJSON-775626346-project-member] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 809.557292] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 809.557820] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.557820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.557820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.558761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.558761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.558761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.558761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.558761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.558761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.558761] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.587768] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.587960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.588099] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.588357] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.588612] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.588765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.588876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.589121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.589266] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.589476] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.589587] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.589692] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.589795] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.589900] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.590009] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.590165] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.616069] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.616371] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.616586] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.616807] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.617200] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-9ed0455b-e49a-47f3-abf1-facf064b96db taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.617429] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.617623] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.618486] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.618771] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed0455b-e49a-47f3-abf1-facf064b96db',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.626045] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.626045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.626045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.626045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.626045] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.626443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.626443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.626443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.626443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.626443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.626625] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.627666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.627787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.627787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.627945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.648729] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.648729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.650365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.651122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.653018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.653018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.653018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.653018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.653018] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 809.653351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.653733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.661687] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.663095] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.663095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.663562] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.671289] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.671481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.671579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.671832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.672731] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.672731] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.683874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.683874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.684526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.684526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.684526] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.684526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.684798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.684798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.684908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.685068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.685166] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.686092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.686227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.686438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.686574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.686721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.686849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.687037] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.687163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.687250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.687417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.687529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.687640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.687750] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.690710] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.691060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.691165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.691418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.691544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.700524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.700524] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1748825f-41ff-4cb0-8413-0bbb18bc3793 is going to be deleted. [ 809.704342] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.704521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.704662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.704805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.707681] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.707681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.707681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.707931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.707931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.708034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.708091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.708327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.708438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.708535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.708708] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.708808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.708870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.709019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.709168] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.709268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.709330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.709514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.709598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.709694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.709787] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.773132] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.773336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.774410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.774563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.775315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.775435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.776210] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.776300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.776873] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 809.777612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.777718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.778767] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.778767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.779389] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.779389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.780092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.780184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.781145] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.781145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.781762] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.782129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.782214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.783438] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.783438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.783438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.785295] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.785870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.785870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.795523] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.797685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.797685] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.797685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.797685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.797685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.797685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.797685] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 is going to be updated. [ 809.798311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.798506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.819665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.819853] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a60c2e7-c063-4bbc-be63-e2c41ed90972 is going to be deleted. [ 809.820899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.821142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.833066] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.833279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.833279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.833450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.833618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.840105] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.840311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.845615] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 in Status: IN_PROGRESS for 2s [ 809.853288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.853580] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be deleted. [ 809.854751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.855284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.895809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.896307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.898937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.899105] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d is going to be deleted. [ 809.900198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.900416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.900524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.900626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 is going to be deleted. [ 809.901632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.901817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.956249] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.956407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.957520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.957669] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b094a3d7-f106-4b6e-99e8-eb21f21b3609 is going to be deleted. [ 809.958655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.958893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.999525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.999667] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0923c94e-4f06-4310-bba9-cc69436848ce is going to be deleted. [ 810.000605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.000826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.005705] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.005812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.050026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.050245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.058616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.058616] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a1ceaf1-c0bf-46d2-84a1-4263d547ce05 is going to be deleted. [ 810.059364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.059585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.060576] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.100133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.100133] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b0c3cc-e225-461c-b4fa-14cf951098f5 is going to be deleted. [ 810.100133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.100133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.109122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.109357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.123559] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.123833] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.124895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.124895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.124895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.124895] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 9ed0455b-e49a-47f3-abf1-facf064b96db not found, creating... [ 810.124895] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.125196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.125196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.125360] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.125490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.125811] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.125974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.126097] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.126298] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.126422] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.126574] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 9ed0455b-e49a-47f3-abf1-facf064b96db is going to be created. [ 810.134022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.134022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.134022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.134022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.134856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.134856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.134856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.134856] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.164620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.164744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.169397] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.169781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.169949] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.170719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.170719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.170923] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.171886] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.172030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.172141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.172345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.172558] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.172738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.172944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.173055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.173122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.173206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.173874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.173874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.173874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.173874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.173874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.174123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.174123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.174123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.174219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.174280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.174387] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.178026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.178146] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b940b435-c759-4394-856d-7ee660b5983d is going to be deleted. [ 810.179215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.179413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.179503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.179602] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be deleted. [ 810.180619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.180757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.190718] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.203563] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.203898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.203898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.203995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.204189] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.204282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.204351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.204499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.204644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.204701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.204803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.204915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.204972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.205126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.205263] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.205345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.205394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.205532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.205643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.205709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.205804] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.226110] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6518e255-8a48-4fe6-8c80-b478b31e143a: rpc.has_security_group_logging(os_id): False [ 810.296384] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.296580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.305390] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.305390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.307225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.307353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.346818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.347065] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20197510-1697-4884-9af2-fab8e2bd3774 is going to be deleted. [ 810.348178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.348459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.383943] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.384227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.413885] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.413885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.420530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.420683] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a is going to be deleted. [ 810.422023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.422023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.422023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.422183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1748825f-41ff-4cb0-8413-0bbb18bc3793" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.422284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a60c2e7-c063-4bbc-be63-e2c41ed90972" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6aa010d3-44c8-4d3d-9ed3-7e6f10a85f1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b094a3d7-f106-4b6e-99e8-eb21f21b3609" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.426358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.426358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.426358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.426544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0923c94e-4f06-4310-bba9-cc69436848ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.426851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.426928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.524015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.524308] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.524477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.524561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.524808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.525099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.525360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.525508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.525592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.525803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.525893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.529809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.529996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.530091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.530303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.530399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.530552] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 810.532082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.532311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.532425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.532646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a1ceaf1-c0bf-46d2-84a1-4263d547ce05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.532800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.532967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.533146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.533297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b0c3cc-e225-461c-b4fa-14cf951098f5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.533458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.533635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.533717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.533839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.533990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.534147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.534222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.534329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b940b435-c759-4394-856d-7ee660b5983d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.563499] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.583501] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.584141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.584277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.584534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.584668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.585287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20197510-1697-4884-9af2-fab8e2bd3774" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.636735] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd68ac80-456d-40a6-bada-de320b838ff6: rpc.has_security_group_logging(os_id): False [ 810.677768] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.678630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.678630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.678630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.679864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9664a1c4-6b34-480a-af3f-b95cb52e088f: rpc.has_security_group_logging(os_id): False [ 810.685717] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.685717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.692736] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40da76d9-e82a-4df1-a543-dfbd1d154789: rpc.has_security_group_logging(os_id): False [ 810.708463] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e016bdc-1186-4d65-a6a4-b589ea567689: rpc.has_security_group_logging(os_id): False [ 810.712908] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.713107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.714926] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.715124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.723329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.723869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.724761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.724761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.724761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.724761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.724761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.725042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.725042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.725108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.725331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.725451] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.725555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.725607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.725753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.725890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.725961] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be updated. [ 810.728135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.728135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.728135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.728135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e14011a-9acf-4d8e-a5ba-2fbf9d34eb5a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.728135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.728135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.757020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.757159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.758292] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.758292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.774576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.775846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.775846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.775846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.775846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.775846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.776098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.776166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.776262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.776502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.776607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.776833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.776980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.777123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.777321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.777403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.777506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be updated. [ 810.778971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.779176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.779429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.780720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.780982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.835521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.835833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.835933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.836108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.836223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.836303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.836561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.836561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.836694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.836758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.836898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.837022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.837156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.837156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.837343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.837442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.837525] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 810.838932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.841341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.861605] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 810.897590] env[66131]: INFO networking_nsxv3.common.synchronization [req-d9894317-5d9e-4851-8f1c-0b485d9a67f3 req-53c912f7-df52-43fc-94ce-84971df42054 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 810.897840] env[66131]: INFO networking_nsxv3.common.synchronization [req-d9894317-5d9e-4851-8f1c-0b485d9a67f3 req-53c912f7-df52-43fc-94ce-84971df42054 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 810.897977] env[66131]: INFO networking_nsxv3.common.synchronization [req-d9894317-5d9e-4851-8f1c-0b485d9a67f3 req-53c912f7-df52-43fc-94ce-84971df42054 service nova] Enqueued Resource ID: 9ed0455b-e49a-47f3-abf1-facf064b96db with Priority: HIGHEST for action port [ 810.898642] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 810.898793] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 810.898890] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed0455b-e49a-47f3-abf1-facf064b96db with Priority: HIGHEST for action port [ 810.899225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.899352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.899419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.899628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.899712] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.900759] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.900852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.901590] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ed0455b-e49a-47f3-abf1-facf064b96db taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.901590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.901590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.901590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.901904] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed0455b-e49a-47f3-abf1-facf064b96db',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.940104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.940438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.940583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.940662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.940874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.940960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.941065] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 is going to be updated. [ 810.968900] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.969274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.969274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.969442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.969637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.004983] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 811.037271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.037414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.037475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.037767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.037975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.060769] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.060885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.060885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.061151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.061284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.070048] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 811.070624] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.070786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.070851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.071104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.071212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.071327] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 811.113719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.114080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.114149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.114544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.114914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.148632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: IN_PROGRESS for 2s [ 811.149655] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 811.186847] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 811.186847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.186847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.186847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.186847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.186847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.199761] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 811.211424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 4s [ 811.400761] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: SUCCESS [ 811.401036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.403649] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.403821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.409031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ed0455b-e49a-47f3-abf1-facf064b96db with status ACTIVE [ 811.409031] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.409031] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.409031] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.409031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.409031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ed0455b-e49a-47f3-abf1-facf064b96db is going to be updated. [ 811.431333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.431492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.431566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.431801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.431953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.432552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ed0455b-e49a-47f3-abf1-facf064b96db" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.789376] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 811.789644] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 811.789686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.789835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.790075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.790278] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.790354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.790423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.790602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.790692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.790773] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.860629] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 in Status: SUCCESS [ 811.860839] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f4e511e-ecb4-4925-bb07-ae0e14be7969 deletion is rescheduled due to dependency. [ 811.860991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f4e511e-ecb4-4925-bb07-ae0e14be7969" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.294017] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.797356] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.883471] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 812.883696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.021589] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 813.021832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.083813] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 813.084047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.163543] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: SUCCESS [ 813.163543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.165741] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 813.165956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.212412] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 813.212735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.214405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.214905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.214986] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.215086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.215140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.215584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.215698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.216122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.216122] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.225221] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 813.226793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.227050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.227283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.228233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.228233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.228233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.228233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.228233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.228233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.228233] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.301930] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.302162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.302162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.302393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.302483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.302606] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 813.335227] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.335227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.335227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.335227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.335227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.345208] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 813.719143] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.719143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.719143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.719143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.719143] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.719143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.719143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.719481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.719481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.719481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.719651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.719651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.719722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.719929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.720037] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.720037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.720127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.720245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.720322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.720413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.720536] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.730410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.730857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.730857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.731122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.731194] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.731273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.731326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.731485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.731577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.731673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.731843] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.731949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.732066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.732473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.732473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.732473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.732473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.732920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.732920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.732920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.732920] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.184735] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 814.184735] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 814.185377] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 814.185377] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 814.185847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.185955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.186013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.186246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.186560] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.186560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.186560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.186752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.187008] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.187008] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.187806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.187917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.187984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.188197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.188371] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.188472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.188523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.188673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.188717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.188777] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.222921] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f85143-50cb-4ea4-b72b-837126da5251: rpc.has_security_group_logging(os_id): False [ 814.236310] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 814.248407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.248562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.248764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.248893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.262504] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_rules [ 814.263201] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 814.263201] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 814.264043] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 814.264043] env[66131]: INFO networking_nsxv3.common.synchronization [req-d18e5596-3fec-44ca-a4d0-eb384a3aeabf req-083397b5-3cfd-4871-b92d-bcc052f3002e tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: e9887383-fb19-42f5-a0cc-f978dbd0207c with Priority: HIGHEST for action port [ 814.264974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.264974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.265480] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_rules [ 814.265725] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 814.265725] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9887383-fb19-42f5-a0cc-f978dbd0207c with Priority: HIGHEST for action port [ 814.265910] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 814.266168] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 814.266440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.266554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.266611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.266966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.267550] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.268555] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.268719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.268894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9887383-fb19-42f5-a0cc-f978dbd0207c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.269044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.269107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.269476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.269476] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9887383-fb19-42f5-a0cc-f978dbd0207c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.271184] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.271184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.271184] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.271184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.272715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.272941] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.273062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.273132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.273317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.273403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.273617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.273735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.273797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.273945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.274034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.274233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.274325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.274677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.274677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.274677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.274677] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 814.275732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.276111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.310363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.310745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.310915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.310971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.311183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.311270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.311461] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.311553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.311612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.311861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.311861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.312066] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.312475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.312475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.312475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.312475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.312887] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 814.343289] env[66131]: INFO networking_nsxv3.common.synchronization [req-1f1dbd32-37f7-41ac-8936-be3e3955acd1 req-127ea580-5e08-4081-bbe9-123f026712d1 tempest-ServersWithSpecificFlavorTestJSON-1087626551 tempest-ServersWithSpecificFlavorTestJSON-1087626551-project-member] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 814.343863] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 814.344137] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.348974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.348974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.348974] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.386460] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.387060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.387060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.387060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.387207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.396554] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.396748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.396867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.397036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.397155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.407599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 814.413566] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 814.690223] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.691515] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.722657] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.722864] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.722984] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.723264] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.723579] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.723709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.723823] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.724105] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.724260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.724469] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.724572] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.724683] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.724833] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.724895] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.725032] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.725129] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.744584] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.744749] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.744899] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.745250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-242" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.745462] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-14e45007-8484-4190-b979-72907e4c5a53 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.745630] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.745914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.746128] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.746256] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e45007-8484-4190-b979-72907e4c5a53',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.775770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.775770] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9887383-fb19-42f5-a0cc-f978dbd0207c with status ACTIVE [ 814.775770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.775770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.776286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.776286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.776286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.776286] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9887383-fb19-42f5-a0cc-f978dbd0207c is going to be updated. [ 814.803211] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.803211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.803211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.803211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.803211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.803211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.847739] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.848143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.848285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.848647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.890412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.890771] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.890967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.891122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.891453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.891631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.891868] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be updated. [ 814.938836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.939170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.939170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.939371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.939412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.958686] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: IN_PROGRESS for 2s [ 815.192920] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.193595] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.248728] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.248967] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.249097] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.249395] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.249610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.249764] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 14e45007-8484-4190-b979-72907e4c5a53 not found, creating... [ 815.250048] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.250212] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.250328] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.250571] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.250820] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.251108] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.251352] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.251433] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.251686] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.251808] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.251927] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 14e45007-8484-4190-b979-72907e4c5a53 is going to be created. [ 815.306707] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.306987] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.307202] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.307617] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.308015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.308831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.360245] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.360245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.360245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.360245] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.695571] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.695571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.695571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.695884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.695884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.695961] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be created. [ 815.697335] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.697482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.697521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.697703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.697772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.697824] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 815.728930] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.729238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.729238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.729396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.729564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.731636] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.731812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.731812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.732022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.732158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.745993] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 815.748511] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: UNINITIALIZED for 2s [ 815.864759] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.865048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.865048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.865295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.865494] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.865618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.865688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.865841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.865946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.866071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.866234] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.866349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.866412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.866569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.866736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.866881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.866915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.867081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.867161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.867258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.867378] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.064797] env[66131]: INFO networking_nsxv3.common.synchronization [req-1f1dbd32-37f7-41ac-8936-be3e3955acd1 req-c31e7496-db3d-497e-b1c5-a813ba3423e6 service nova] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 816.064990] env[66131]: INFO networking_nsxv3.common.synchronization [req-1f1dbd32-37f7-41ac-8936-be3e3955acd1 req-c31e7496-db3d-497e-b1c5-a813ba3423e6 service nova] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 816.065144] env[66131]: INFO networking_nsxv3.common.synchronization [req-1f1dbd32-37f7-41ac-8936-be3e3955acd1 req-c31e7496-db3d-497e-b1c5-a813ba3423e6 service nova] Enqueued Resource ID: 14e45007-8484-4190-b979-72907e4c5a53 with Priority: HIGHEST for action port [ 816.065705] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_rules [ 816.065848] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 816.065943] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e45007-8484-4190-b979-72907e4c5a53 with Priority: HIGHEST for action port [ 816.066236] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.066356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.066455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.066642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.066726] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.068047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.068154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.068363] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e45007-8484-4190-b979-72907e4c5a53 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.068471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.068531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.070300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.070300] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e45007-8484-4190-b979-72907e4c5a53',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.370089] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4e8c15-6df2-42fb-824c-bb556c5b499a: rpc.has_security_group_logging(os_id): False [ 816.389581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.389676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.389909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.390042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.390156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.390359] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.390492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.390550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.390717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.390796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.390997] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.391101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.391162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.391298] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.391366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.391556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.391677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.391677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.391841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.392204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.392204] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be created. [ 816.432538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 816.433719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.436754] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 816.437105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.437365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.437681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.437815] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.484563] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.484727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.484835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.485164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.485441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.570599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.570842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.570977] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e45007-8484-4190-b979-72907e4c5a53 with status ACTIVE [ 816.571534] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.571534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.571813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.572308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.572474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.572942] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.573140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.573189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.573352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.573462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.573855] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.574069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.574129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.574297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.574383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.574455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e45007-8484-4190-b979-72907e4c5a53 is going to be updated. [ 816.584938] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 816.614990] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.615150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.615150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.615398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.615487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.615656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e45007-8484-4190-b979-72907e4c5a53" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.947307] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.947517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.970769] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 816.970949] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f deletion is rescheduled due to dependency. [ 816.971370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.971551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.972328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.972328] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.972328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.972692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.972692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.973067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.973215] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.476341] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.760509] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 817.760880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.761116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.761388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.762862] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.762862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.762862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.762862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.762862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.762862] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.764831] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 817.765056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.765492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.765711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.765892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.766049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.766190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.767544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.767544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.767544] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.979189] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.269668] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.270631] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.482245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.482533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.482533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.482796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.482895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.483019] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be updated. [ 818.522038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.522038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.522038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.523123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.523490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.538079] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: IN_PROGRESS for 2s [ 818.572948] env[66131]: INFO networking_nsxv3.common.synchronization [req-a4d81bf5-f5f5-4ac9-8d45-ed4b34e75caf req-62cf91f0-c411-471f-98f2-e31945292b9f tempest-ServerMetadataTestJSON-332631190 tempest-ServerMetadataTestJSON-332631190-project-member] Enqueued Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_members [ 818.572948] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGHEST for action security_group_members [ 818.572948] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.573444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.573444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.573541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.573744] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.573897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.573947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.574187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.575142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.575142] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.607619] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 818.607807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.773111] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.776399] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.077175] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.077349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.077349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.077522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.078144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.078144] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.078144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.078144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.078144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.078411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.078411] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af is going to be updated. [ 819.105966] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.106106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.106106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.106313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.106454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.117534] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: IN_PROGRESS for 2s [ 819.278172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.278172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.278172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.278172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.278172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.278172] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 819.279968] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.279968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.279968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.279968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.279968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.279968] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be updated. [ 819.341261] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.341261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.341740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.341740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.341740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.343826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.343964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.344044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.344261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.344403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.356919] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 819.357879] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: IN_PROGRESS for 2s [ 820.548752] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 820.549136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.549182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.549443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.549639] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.549757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.549823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.550396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.550396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.550396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.550396] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.052622] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.128596] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af in Status: SUCCESS [ 821.128811] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af deletion is rescheduled due to dependency. [ 821.128904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.371037] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 821.371037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.371037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.371365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.371582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.371741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.371835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.372140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.372269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.372387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.372509] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.374405] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 821.374631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.374825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.375101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.375320] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.375508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.375609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.375808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.375923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.376047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.376165] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.556860] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f3bfadc-ee4e-4dd7-a668-86025968cc1f: rpc.has_security_group_logging(os_id): False [ 821.578982] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.579148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.579223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.579444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.579540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.579818] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.579915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.579979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.580143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.580221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.580309] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be updated. [ 821.639200] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.639349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.639423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.639745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.639827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.652543] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: IN_PROGRESS for 2s [ 821.878046] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.878888] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.879041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.879121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.879331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.879500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.879595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.879671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.879847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.879947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.880046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.880643] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.880643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.880643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.880643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.880643] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.881057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.881057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.881057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.881238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.881238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.881360] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.994305] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 821.994542] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_members [ 821.994792] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 821.995919] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 821.996170] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_members [ 821.996379] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 821.996906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.997821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.997962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.998289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.998547] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.998736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.998860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.999110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.999243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.999488] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.000687] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9828a02a-4bba-4c38-b718-529755d66d03 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.000881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.000881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.001240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.001481] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.001638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.001719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.001955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.002084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.002232] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.003519] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.004060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.004060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.004060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.004268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.004413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.004575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.004859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.004896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.005131] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.057565] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_rules [ 822.058448] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 822.059265] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_rules [ 822.059663] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_members [ 822.060305] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 822.061735] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 822.061735] env[66131]: INFO networking_nsxv3.common.synchronization [req-49d55d09-687b-4b6c-8683-a31794d39621 req-f8c85716-f362-4c38-96e0-b6fb1034f8c5 tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: e9887383-fb19-42f5-a0cc-f978dbd0207c with Priority: HIGHEST for action port [ 822.062940] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_rules [ 822.063237] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_rules [ 822.063431] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 822.064040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9887383-fb19-42f5-a0cc-f978dbd0207c with Priority: HIGHEST for action port [ 822.064040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_rules [ 822.064040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 822.064471] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_members [ 822.065018] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.065169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.066055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9828a02a-4bba-4c38-b718-529755d66d03 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.066055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.066055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.066411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.066455] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.067972] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.068153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.068868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9887383-fb19-42f5-a0cc-f978dbd0207c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.069048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.069139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.069411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.069531] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9887383-fb19-42f5-a0cc-f978dbd0207c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.075604] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.075604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.075882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.076059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.076302] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9828a02a-4bba-4c38-b718-529755d66d03 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.076362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.383414] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54bcb296-38dd-4765-9095-b0ead7c5de56: rpc.has_security_group_logging(os_id): False [ 822.384643] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 822.403036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.403216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.403312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.403495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.403586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.403783] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.403892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.403968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.404117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.404193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.404252] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be created. [ 822.406692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.406822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.407555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.407555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.407555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.407555] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.408227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.408227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.408227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.408227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.408401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.408495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.408558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.408695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.408775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.408962] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.409042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.409099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.409248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.409312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.409402] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 822.470864] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.471044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.471120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.471348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.471530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.477601] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.477740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.477814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.478254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.478432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.485261] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: IN_PROGRESS for 2s [ 822.493262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 822.508871] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.509868] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.510769] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.580232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9828a02a-4bba-4c38-b718-529755d66d03 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.580232] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9887383-fb19-42f5-a0cc-f978dbd0207c with status ACTIVE [ 822.580232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.580232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.580232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.581093] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.581093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.581093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.581093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.581093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.581093] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9887383-fb19-42f5-a0cc-f978dbd0207c is going to be updated. [ 822.623017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.623155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.623155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.623433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.623583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.623771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9887383-fb19-42f5-a0cc-f978dbd0207c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.012253] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.014950] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.014950] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.517309] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.517474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.517613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.517744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.518450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.518450] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 is going to be created. [ 823.519255] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.519375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.519443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.519611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.519715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.519843] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be updated. [ 823.520835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.520943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.521021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.521168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.521246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.521338] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 823.553620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.553830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.553910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.554178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.554346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.556531] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.556689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.556739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.556904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.557062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.558672] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.558803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.558878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.559062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.559192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.567933] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 823.568664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9828a02a-4bba-4c38-b718-529755d66d03 in Status: UNINITIALIZED for 2s [ 823.570144] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: IN_PROGRESS for 2s [ 823.666771] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 823.667052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.500670] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 824.500948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.501162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.501394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.501492] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.512818] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 824.513022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.513207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.513421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.513510] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.006499] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.007717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.017056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.017056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.125581] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5d6b2c5-993e-4368-aaed-82e242db639a req-8153d9e4-5660-4366-9326-91729b0d4aff tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 825.125774] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5d6b2c5-993e-4368-aaed-82e242db639a req-8153d9e4-5660-4366-9326-91729b0d4aff tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_members [ 825.125932] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5d6b2c5-993e-4368-aaed-82e242db639a req-8153d9e4-5660-4366-9326-91729b0d4aff tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 825.126645] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 with Priority: HIGHEST for action security_group_members [ 825.126734] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9828a02a-4bba-4c38-b718-529755d66d03 with Priority: HIGHEST for action security_group_members [ 825.126790] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 825.127121] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bcb296-38dd-4765-9095-b0ead7c5de56 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.127231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.127886] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9828a02a-4bba-4c38-b718-529755d66d03 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.127886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.127886] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.127886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.580853] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 825.581098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.581266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.581493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.581677] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.581790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.581858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.581997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.582102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.582205] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.588487] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 825.588796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.592416] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9828a02a-4bba-4c38-b718-529755d66d03 in Status: SUCCESS [ 825.592416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.592416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.592840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.596603] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.596603] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.596603] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.596603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.596603] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.099702] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.100912] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.101080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.101183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.101425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.101531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.101761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.101874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.101999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.102167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.102253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.102395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be updated. [ 826.104396] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.104396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.104396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.104396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.104396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.104660] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.104660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.104660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.104810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.104887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.105015] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 is going to be deleted. [ 826.135882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.136088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.136146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.136342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.136433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.136551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.136685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.136835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.136999] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.137110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.137172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.137304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.137380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.137471] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.139805] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.139935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.140015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.140185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.140388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.150378] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: IN_PROGRESS for 2s [ 826.422218] env[66131]: INFO networking_nsxv3.common.synchronization [req-c16e7461-6e17-40b7-a282-af3d55c5f06a req-8e3d166d-cbc6-4c32-9797-b92bd8e20800 tempest-ListImageFiltersTestJSON-907682754 tempest-ListImageFiltersTestJSON-907682754-project-member] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 826.423484] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 826.424325] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.426793] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.426793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.426793] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.604672] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.642927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.643180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.643273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.643498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.643620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.643966] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.644144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.644246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.644443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.644534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.644622] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 already deleted. [ 826.644704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.644908] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.646106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.646444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.646673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.646897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.646973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.647204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.647310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.647389] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.931834] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.111409] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.111409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.111409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.111409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.111409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.111409] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 827.151150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.151379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.151379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.151597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.151749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.153086] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9828a02a-4bba-4c38-b718-529755d66d03',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.157307] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.157439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.157512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.157722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.157827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.157997] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.158125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.158187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.158335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.158422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.158487] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 already deleted. [ 827.158564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.169026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 827.437081] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.660390] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9828a02a-4bba-4c38-b718-529755d66d03: rpc.has_security_group_logging(os_id): False [ 827.680471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.680471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.680471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.681116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.681223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.681736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.681878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.682015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.682215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.682314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.682408] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 is going to be created. [ 827.710534] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9828a02a-4bba-4c38-b718-529755d66d03], does not exist path=[/infra/domains/default/groups/9828a02a-4bba-4c38-b718-529755d66d03]."\n}' [ 827.711585] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9828a02a-4bba-4c38-b718-529755d66d03 [ 827.711720] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 827.770022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.770022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.770022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.770022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.770832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.771389] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.771674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.771840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.774017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.774017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.774017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.774017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.774017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.774017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.774017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.774017] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9828a02a-4bba-4c38-b718-529755d66d03 is going to be created. [ 827.796805] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9828a02a-4bba-4c38-b718-529755d66d03], does not exist path=[/infra/domains/default/groups/9828a02a-4bba-4c38-b718-529755d66d03]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9828a02a-4bba-4c38-b718-529755d66d03 [ 827.796953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9828a02a-4bba-4c38-b718-529755d66d03" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.797878] env[66131]: Traceback (most recent call last): [ 827.797979] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 827.797979] env[66131]: return func(*args, **kwargs) [ 827.797979] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 827.797979] env[66131]: res.raise_for_status() [ 827.797979] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 827.797979] env[66131]: raise HTTPError(http_error_msg, response=self) [ 827.797979] env[66131]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9828a02a-4bba-4c38-b718-529755d66d03 [ 827.797979] env[66131]: During handling of the above exception, another exception occurred: [ 827.797979] env[66131]: Traceback (most recent call last): [ 827.797979] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 827.797979] env[66131]: listener.cb(fileno) [ 827.797979] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 827.797979] env[66131]: result = function(*args, **kwargs) [ 827.797979] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 827.797979] env[66131]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 827.797979] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 827.797979] env[66131]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 827.797979] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 827.797979] env[66131]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 827.797979] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 827.797979] env[66131]: res.raise_for_status() [ 827.797979] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 827.797979] env[66131]: raise HTTPError(http_error_msg, response=self) [ 827.797979] env[66131]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9828a02a-4bba-4c38-b718-529755d66d03 [ 827.797979] env[66131]: Removing descriptor: 25 [ 827.941292] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.941600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.941681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.941919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.943401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.943401] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be updated. [ 827.978343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.978343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.978343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.978343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.978343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.986766] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 828.163226] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 828.163599] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 deletion is rescheduled due to dependency. [ 828.163599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.163903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.163903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.164101] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.164220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.164282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.164438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.164518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.164603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.164701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.165622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.168677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.168677] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.168677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.168677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.168677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.168677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.168677] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.672036] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54bcb296-38dd-4765-9095-b0ead7c5de56',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.673121] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.673259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.673333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.673540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.695796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.696077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.696226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.696321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.696458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.696549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.696628] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be updated. [ 828.729781] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.729781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.729781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.729781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.729781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.739610] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: IN_PROGRESS for 2s [ 829.175944] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54bcb296-38dd-4765-9095-b0ead7c5de56: rpc.has_security_group_logging(os_id): False [ 829.181707] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 829.181937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.182146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.182468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.182713] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.182938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.182938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.183049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.183134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.183431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.183431] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.184277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.184370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.184538] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.184640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.184704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.184844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.184925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.185038] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.198056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.198056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.198056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.198347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.198404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.198736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.198910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.199097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.199544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.199695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.199843] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 is going to be updated. [ 829.308641] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.311113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.311113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.311113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.311113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.323528] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: IN_PROGRESS for 2s [ 829.686907] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.687090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.687301] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.999225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 829.999536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.191033] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.693015] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.693259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.693859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.694131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.694278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.694519] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 830.726310] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.726469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.726578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.726903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.726903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.737537] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 830.749387] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 830.749387] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 deletion is rescheduled due to dependency. [ 830.749387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.339103] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54bcb296-38dd-4765-9095-b0ead7c5de56 in Status: SUCCESS [ 831.339363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54bcb296-38dd-4765-9095-b0ead7c5de56" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.425820] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 831.425820] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 832.747511] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 832.747962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.747962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.748120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.748257] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.748381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.748438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.748594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.748676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.748760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.748916] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.748999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.749074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.749229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.749439] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.749584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.749642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.749750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.749825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.750204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.750407] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.253601] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 833.277505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.277704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.277813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.278190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.320364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.320689] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.320856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.320919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.321186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.321285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.321498] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.321624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.321715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.321903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.321999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.323059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.323409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.323502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.324109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.324109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.324109] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 833.413622] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.413834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.413930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.414297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.414492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.438334] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 834.647169] env[66131]: INFO networking_nsxv3.common.synchronization [req-59bec67e-4287-4cd8-8896-9e0e61638d23 req-6756ea17-a41a-47a6-b815-b47b0499babd tempest-ListServerFiltersTestJSON-1463311190 tempest-ListServerFiltersTestJSON-1463311190-project-member] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 834.647169] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 834.647169] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.647169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.647169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.647169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.651177] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.651397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.651397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.651569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.651657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.651772] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.155869] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.463840] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 835.464173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.464374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.464616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.464708] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.659229] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.968953] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.968953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.968953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.970531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.970860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.970989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.971088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.971344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.971344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.971434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.971532] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.163457] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.163457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.163457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.163457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.163457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.163457] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 836.193321] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.193508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.193554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.193754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.193919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.203732] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 836.474652] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.475488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.475488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.476561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.476561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.476561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.476561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.476979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.476979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.476979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.477172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.477328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.477442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.477955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.477955] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.478190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.478190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.478504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.478504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.478504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.478621] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.981910] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad174bf4-cd31-47d0-b677-2a143083800a: rpc.has_security_group_logging(os_id): False [ 836.999480] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.999803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.999803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.999958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.000068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.000293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.000395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.000451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.000600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.000697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.000952] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.001075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.001147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.001352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.001461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.001579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.001674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.001730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.001881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.001982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.002063] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 837.069869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.070074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.070139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.070308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.070453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.087954] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 838.214079] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 838.214522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.112470] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 839.112854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.647478] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 839.647782] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 844.649286] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 844.649286] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 844.790641] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d2c1674-e55e-4bec-862f-6b7d30fcf9f3 req-b73f0545-a0ae-4a42-9cf3-2fae11ed635b tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 844.791342] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 844.791708] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.791838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.791907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.792165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.792344] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.792446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.792512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.792663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.792750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.792867] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.295227] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.799031] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.301558] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.301726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.301795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.302051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.302301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.302301] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 846.331882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.332037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.332107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.332319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.332466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.340946] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 847.550313] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2df532ab-324c-4e5d-a412-bd015998a22b None None] Enqueued Resource ID: 3b2786f3-02f6-42ea-be6c-435ae712efd1 with Priority: HIGHEST for action port [ 847.550313] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b2786f3-02f6-42ea-be6c-435ae712efd1 with Priority: HIGHEST for action port [ 847.550599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b2786f3-02f6-42ea-be6c-435ae712efd1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.550911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b2786f3-02f6-42ea-be6c-435ae712efd1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.552125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b2786f3-02f6-42ea-be6c-435ae712efd1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.552632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b2786f3-02f6-42ea-be6c-435ae712efd1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.553066] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b2786f3-02f6-42ea-be6c-435ae712efd1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.056943] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b2786f3-02f6-42ea-be6c-435ae712efd1 [ 848.057244] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.057517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.057651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.057916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.058027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.058130] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b2786f3-02f6-42ea-be6c-435ae712efd1 already deleted. [ 848.058218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b2786f3-02f6-42ea-be6c-435ae712efd1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.351909] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 848.352168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.536328] env[66131]: INFO networking_nsxv3.common.synchronization [None req-29926ca1-7f3f-4137-82bd-69e09c5434bc tempest-ServersTestFqdnHostnames-1386842827 tempest-ServersTestFqdnHostnames-1386842827-project-member] Enqueued Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_rules [ 848.536702] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_rules [ 848.536958] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.537180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.537233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.538038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.538038] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.621445] env[66131]: INFO networking_nsxv3.common.synchronization [None req-fa1bbe9d-ebf3-482e-8592-995c638f8fbe tempest-ServersTestFqdnHostnames-1386842827 tempest-ServersTestFqdnHostnames-1386842827-project-member] Enqueued Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_rules [ 848.622401] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_rules [ 848.622481] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.622554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.059669] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.059669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.059669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.059889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.059925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.060345] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef72789-9405-4544-841f-1905c2771a0d already deleted. [ 849.060345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.061012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.061247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.061404] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.586769] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.586961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.586961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.587150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.587243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.587335] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef72789-9405-4544-841f-1905c2771a0d already deleted. [ 849.587416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.609500] env[66131]: INFO networking_nsxv3.common.synchronization [req-5ee1f189-a00f-485d-9540-d0153f91c295 req-d104b83b-f6db-4374-ada7-f7f1ea4193c2 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 849.610055] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 849.610375] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.610500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.610564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.610830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.611012] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.611711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.611711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.611814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.611884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.611982] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.730166] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f0aa82b2-07d1-4f13-8902-70ff87b89485 None None] Enqueued Resource ID: e795e84d-8973-4243-9b36-7c83c40f4b54 with Priority: HIGHEST for action port [ 849.730856] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e795e84d-8973-4243-9b36-7c83c40f4b54 with Priority: HIGHEST for action port [ 849.731475] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e795e84d-8973-4243-9b36-7c83c40f4b54 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.731602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e795e84d-8973-4243-9b36-7c83c40f4b54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.731667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e795e84d-8973-4243-9b36-7c83c40f4b54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.731955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e795e84d-8973-4243-9b36-7c83c40f4b54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.732081] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e795e84d-8973-4243-9b36-7c83c40f4b54',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.914501] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.914725] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.914831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.915234] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.915381] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.915511] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.915623] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.915832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.915975] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.916199] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.916309] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.916414] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.916518] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.916622] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.916725] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.916852] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.938222] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.938222] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.938222] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.938344] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.938745] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-4f30b185-cb46-4516-acff-84176128326a taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.938943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.939072] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.939381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.939574] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f30b185-cb46-4516-acff-84176128326a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.114188] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.114412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.114488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.114712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.114804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.115014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.115119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.115180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.115332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.115435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.115522] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e already deleted. [ 850.115606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.234766] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e795e84d-8973-4243-9b36-7c83c40f4b54 [ 850.234998] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.235135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.235737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.235737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.235737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.235737] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e795e84d-8973-4243-9b36-7c83c40f4b54 already deleted. [ 850.235737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e795e84d-8973-4243-9b36-7c83c40f4b54" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.442400] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.442400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.442400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.442400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.442400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.442991] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 4f30b185-cb46-4516-acff-84176128326a not found, creating... [ 850.442991] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.442991] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.443394] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.443394] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.443394] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.444298] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.445535] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.445535] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.445535] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.445535] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.445535] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 4f30b185-cb46-4516-acff-84176128326a is going to be created. [ 850.464683] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.464886] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.465019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.465286] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.465510] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.465726] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.189499] env[66131]: INFO networking_nsxv3.common.synchronization [req-5ee1f189-a00f-485d-9540-d0153f91c295 req-ba031450-6911-4526-b340-cbf2e97fdf69 service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 851.189776] env[66131]: INFO networking_nsxv3.common.synchronization [req-5ee1f189-a00f-485d-9540-d0153f91c295 req-ba031450-6911-4526-b340-cbf2e97fdf69 service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 851.189825] env[66131]: INFO networking_nsxv3.common.synchronization [req-5ee1f189-a00f-485d-9540-d0153f91c295 req-ba031450-6911-4526-b340-cbf2e97fdf69 service nova] Enqueued Resource ID: 4f30b185-cb46-4516-acff-84176128326a with Priority: HIGHEST for action port [ 851.190313] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 851.190447] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 851.190568] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f30b185-cb46-4516-acff-84176128326a with Priority: HIGHEST for action port [ 851.190846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.190978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.193863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.193863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.193863] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.193863] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.193863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.193863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.194113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.194159] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.194251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.194314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.194455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.194542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.194635] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.195464] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f30b185-cb46-4516-acff-84176128326a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.195569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.195636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.195781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.195856] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f30b185-cb46-4516-acff-84176128326a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.697789] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f30b185-cb46-4516-acff-84176128326a with status ACTIVE [ 851.698047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.698200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.698268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.698547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.698682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.698875] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.698974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.699047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.699269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.699571] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.699571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.699571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.699780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.699859] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f30b185-cb46-4516-acff-84176128326a is going to be updated. [ 851.701016] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.702648] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.702836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.723561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.723785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.723785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.724018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.724178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.724349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f30b185-cb46-4516-acff-84176128326a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.204836] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.707348] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.707585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.707679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.707900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.708039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.708354] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be created. [ 852.734773] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.734983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.735060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.735270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.735437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.753906] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: UNINITIALIZED for 2s [ 853.301669] env[66131]: INFO networking_nsxv3.common.synchronization [req-32033da1-89c7-4d8d-b66b-68c41f2d224a req-feb4220f-629d-4062-8e06-a7635b2a3316 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 853.302335] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 853.302685] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.302824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.302950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.303281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.303466] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.303584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.303656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.303827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.303938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.304078] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.647030] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.647231] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-568" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.647339] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-568" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.647679] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-568" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.647951] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.648135] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.648249] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.648468] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.648605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.648803] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.648910] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.649031] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.649143] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.649249] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.649356] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.649480] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.672070] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.672070] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.672212] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.672419] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-568" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.672784] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-205d637e-51bb-4eef-b0b7-f8620d0e6035 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.673042] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.673184] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.673506] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.673648] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205d637e-51bb-4eef-b0b7-f8620d0e6035',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.809438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.809709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.809810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.810159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.810218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.810545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.810700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.810825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.810970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.811094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.811158] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 already deleted. [ 853.811215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.176303] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.176609] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.176752] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.177086] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.177574] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.177574] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 205d637e-51bb-4eef-b0b7-f8620d0e6035 not found, creating... [ 854.177723] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.177914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.178046] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.178298] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.178475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.178821] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.178986] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.180243] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.180596] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.180746] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.180935] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 is going to be created. [ 854.203776] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.204009] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.204143] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.204482] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.204720] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.205023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.763597] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 854.763898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.764194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.764393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.764594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.764721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.764787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.764946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.765057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.765191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.765267] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.914107] env[66131]: INFO networking_nsxv3.common.synchronization [req-32033da1-89c7-4d8d-b66b-68c41f2d224a req-6ff8e1a9-a396-4686-9b50-6bb7e073ca03 service nova] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_rules [ 854.914303] env[66131]: INFO networking_nsxv3.common.synchronization [req-32033da1-89c7-4d8d-b66b-68c41f2d224a req-6ff8e1a9-a396-4686-9b50-6bb7e073ca03 service nova] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 854.915101] env[66131]: INFO networking_nsxv3.common.synchronization [req-32033da1-89c7-4d8d-b66b-68c41f2d224a req-6ff8e1a9-a396-4686-9b50-6bb7e073ca03 service nova] Enqueued Resource ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 with Priority: HIGHEST for action port [ 854.915101] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_rules [ 854.915101] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 854.915101] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 with Priority: HIGHEST for action port [ 854.915431] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.915558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.915626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.915882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.915967] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.916888] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.917819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.917892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.918080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.918932] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.918932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.918932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.918932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.918932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.918932] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.919436] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-205d637e-51bb-4eef-b0b7-f8620d0e6035 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.919507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.919577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.919732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.919822] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205d637e-51bb-4eef-b0b7-f8620d0e6035',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.268355] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.268777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.268777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.269083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.269321] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.269410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.269492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.269656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.269813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.269852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.270073] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.270171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.270245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.270369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.270562] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.270653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.270692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.270905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.270987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.271062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.271169] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.421837] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.422038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.422194] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.423286] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 205d637e-51bb-4eef-b0b7-f8620d0e6035 with status ACTIVE [ 855.423486] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.423634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.423706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.423937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.424060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.424264] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.424422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.424499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.425185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.425289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.425480] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.425581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.425647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.425803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.425912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.425964] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 is going to be updated. [ 855.450242] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.450242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.450242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.450242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.450242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.450242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.773450] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3951e5e1-7963-4597-8681-5924c72de16e: rpc.has_security_group_logging(os_id): False [ 855.793067] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.793695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.793781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.793998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.794081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.794884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.794884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.794884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.794884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.794884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.794884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.795289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.795289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.795289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.795289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.795471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.795528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.795528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.795672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.795744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.795825] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be created. [ 855.856281] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.856281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.856281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.856281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.857270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.870557] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 855.927942] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.430818] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.431079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.431079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.431300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.431409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.431507] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be created. [ 856.463817] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.464113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.464223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.464487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.464699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.475164] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: UNINITIALIZED for 2s [ 857.882605] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 857.882605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.486870] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 858.487175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.487286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.487745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.487847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.488392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.488392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.488392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.488392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.488392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.488642] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.633980] env[66131]: INFO networking_nsxv3.common.synchronization [req-d25bea67-a7c3-410d-8259-22646789df6e req-dbdd0a2a-9194-40ed-900e-ed5281e02b10 tempest-ServersTestJSON-564409179 tempest-ServersTestJSON-564409179-project-member] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_members [ 858.634519] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_members [ 858.634879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.634999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.635525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.635525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.635525] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.635706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.635706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.635783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.635865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.635975] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.963941] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-248 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.964350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.964350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.964561] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.964802] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.964964] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.965095] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.965336] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.965522] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.965731] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.965842] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.965954] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.966074] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.966184] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.966288] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.966418] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.989836] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.990250] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.990466] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.990771] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-248" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.991169] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.991366] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.991530] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.991875] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.992105] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.993232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.993785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.993940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.994100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.994353] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.994497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.994497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.994611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.994680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.994768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.994926] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.994995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.995067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.995205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.995341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.995456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.995521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.995663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.995801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.995836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.995904] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.138287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.138644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.138644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.138888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.139040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.139270] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.139422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.139491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.139710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.139826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.139941] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 already deleted. [ 859.139995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.529460] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.529460] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 not found, creating... [ 859.529460] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.529460] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.530452] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.530452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 is going to be created. [ 859.530452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ee60aad-d226-4523-a7e1-25a5307d17e8: rpc.has_security_group_logging(os_id): False [ 859.530452] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.530452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.531190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.531190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.531190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.531190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.531968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.531968] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be created. [ 859.533261] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.533583] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.534307] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.534554] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.534781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.535041] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.613565] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.613565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.613565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.613565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.613565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.642625] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 860.232065] env[66131]: INFO networking_nsxv3.common.synchronization [req-d25bea67-a7c3-410d-8259-22646789df6e req-c44d1268-0492-4165-93a8-f9d191b07c69 service nova] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_rules [ 860.232305] env[66131]: INFO networking_nsxv3.common.synchronization [req-d25bea67-a7c3-410d-8259-22646789df6e req-c44d1268-0492-4165-93a8-f9d191b07c69 service nova] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_members [ 860.232470] env[66131]: INFO networking_nsxv3.common.synchronization [req-d25bea67-a7c3-410d-8259-22646789df6e req-c44d1268-0492-4165-93a8-f9d191b07c69 service nova] Enqueued Resource ID: 3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 with Priority: HIGHEST for action port [ 860.233082] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_rules [ 860.233325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_members [ 860.233533] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 with Priority: HIGHEST for action port [ 860.233984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.233984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.233984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.234351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.234351] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.236583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.236818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.237098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.237278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.237434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.238026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.238026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.238026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.238026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.238026] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.238735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.238873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.238956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.239115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.239207] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.741210] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.741339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.741530] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.742812] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 with status ACTIVE [ 860.742812] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.742812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.742812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.743063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.743185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.743341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.743433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.743489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.743642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.743723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.744063] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.744063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.744063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.744208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.744291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.745050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4 is going to be updated. [ 860.779305] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.779442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.779513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.779756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.779867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.780167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3dcb68-cf5b-4a92-847b-9b7bcc006fd4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.246883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.654287] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 861.655361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.749811] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.749811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.749811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.749811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.749811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.750042] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 is going to be created. [ 861.777426] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.777579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.777662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.777887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.778055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.788791] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 in Status: UNINITIALIZED for 2s [ 863.801361] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 in Status: SUCCESS [ 863.801636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.802350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.802350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.802350] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.802350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.802350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.802581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.802581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.802632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.802703] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.943801] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-0b9d1e86-7148-4af3-913b-7b7d850c9c91 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 863.943801] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 863.944940] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.945224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.945434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.945734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.945978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.946205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.946345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.946582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.946745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.946915] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.288295] env[66131]: INFO networking_nsxv3.common.synchronization [req-923da8c9-5f83-40e2-b4cb-eca9b57ba30a req-ff9bf8ba-755c-4122-9ac7-cc2ffd221885 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 864.288921] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 864.289333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.289454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.289454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.289684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.289836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.289964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.290026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.290234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.290280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.290376] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.308658] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.450570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.454278] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.454278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.454278] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be deleted. [ 864.489341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.489560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.489677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.490021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.490502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.490502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.625254] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-900f28b7-8433-4e25-aa88-6e26a2caf4cf tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 864.625465] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 864.625772] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.625889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.625954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.626280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.626516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.626649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.626730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.626909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.627034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.627155] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.796287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.796287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.796287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.796287] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 864.812101] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0d36cff-f4fc-446d-99f9-4c5d0aad46f4: rpc.has_security_group_logging(os_id): False [ 864.832026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.832026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.832026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.832026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.832026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.833871] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.834156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.834297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.834698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.834913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.835295] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.835712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.837239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.837239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.837239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.837239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 is going to be created. [ 864.850909] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 864.934620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.934816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.934864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.935193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.935438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.946821] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 in Status: IN_PROGRESS for 2s [ 865.129713] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.129713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.129917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.130167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.130258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.130387] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.130488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.130888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.130888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.130888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.130888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 already deleted. [ 865.131081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.142832] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.142832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-65" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.143164] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-65" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.143971] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-65" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.143971] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.144283] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.144462] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.144790] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.144992] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.145326] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.145517] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.146306] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.146488] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.146691] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.146892] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.147139] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.169905] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.170016] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.170352] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.170769] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-65" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.171992] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-d57753e7-3690-4df1-aa77-a2935c0964f8 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.171992] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.171992] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.171992] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.172584] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57753e7-3690-4df1-aa77-a2935c0964f8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.676157] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.676334] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.676468] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.676786] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.676970] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.677163] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port d57753e7-3690-4df1-aa77-a2935c0964f8 not found, creating... [ 865.677471] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.677709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.677844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.678094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.678335] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.678516] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.678669] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.678786] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.678983] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.679126] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.679265] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: d57753e7-3690-4df1-aa77-a2935c0964f8 is going to be created. [ 865.698191] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.698400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.698522] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.698899] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.699162] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.699399] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.781904] env[66131]: INFO networking_nsxv3.common.synchronization [None req-95fb9101-b62d-4e0e-8ebe-36a81cec4f1d None None] Enqueued Resource ID: 2fe2ad5f-26a6-4f24-b562-427e5821ceee with Priority: HIGHEST for action port [ 865.782588] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe2ad5f-26a6-4f24-b562-427e5821ceee with Priority: HIGHEST for action port [ 865.783813] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fe2ad5f-26a6-4f24-b562-427e5821ceee taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.783813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fe2ad5f-26a6-4f24-b562-427e5821ceee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.783813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fe2ad5f-26a6-4f24-b562-427e5821ceee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.783813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fe2ad5f-26a6-4f24-b562-427e5821ceee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.783813] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe2ad5f-26a6-4f24-b562-427e5821ceee',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.287973] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fe2ad5f-26a6-4f24-b562-427e5821ceee [ 866.288281] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.288357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.288406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.288618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.288710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.288804] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fe2ad5f-26a6-4f24-b562-427e5821ceee already deleted. [ 866.288969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fe2ad5f-26a6-4f24-b562-427e5821ceee" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.486584] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-b0586738-6ecf-456a-9217-60058695e355 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 866.486867] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-b0586738-6ecf-456a-9217-60058695e355 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 866.487100] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-b0586738-6ecf-456a-9217-60058695e355 service nova] Enqueued Resource ID: d57753e7-3690-4df1-aa77-a2935c0964f8 with Priority: HIGHEST for action port [ 866.490072] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 866.490248] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 866.490363] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d57753e7-3690-4df1-aa77-a2935c0964f8 with Priority: HIGHEST for action port [ 866.491020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.491116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.491163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.491386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.491456] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.492299] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.492404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.492505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.492616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.492982] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.492982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.492982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.493987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.494084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.494148] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.494944] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d57753e7-3690-4df1-aa77-a2935c0964f8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.495062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.495132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.495831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.495831] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57753e7-3690-4df1-aa77-a2935c0964f8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.860583] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 866.860827] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e deletion is rescheduled due to dependency. [ 866.860882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.964382] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 in Status: SUCCESS [ 866.964382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.972695] env[66131]: INFO networking_nsxv3.common.synchronization [req-1178883b-cf5a-446f-9f56-38efb6f7f260 req-2e9d738b-a7e2-4b69-b813-2ce42a2a6f5e tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 866.974568] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 866.974568] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.974568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.974568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.974568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.974568] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.974568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.974568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.974970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.974970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.974970] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.999315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999315] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d57753e7-3690-4df1-aa77-a2935c0964f8 with status ACTIVE [ 866.999315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.999315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.999909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.999909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.999909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999909] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d57753e7-3690-4df1-aa77-a2935c0964f8 is going to be updated. [ 867.001320] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.027476] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.027728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.027890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.028180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.028344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.028514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d57753e7-3690-4df1-aa77-a2935c0964f8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.415790] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.416146] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-322" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.416146] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-322" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.416457] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-322" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.416729] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.416891] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.417015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.417788] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.418079] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.418369] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.418542] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.418695] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.419061] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.419061] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.419255] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.419446] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.441212] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.441385] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.441523] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.441699] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-322" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.442027] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.442205] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.442393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.442660] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.442801] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94f1aa1-42c7-4008-8cc2-557bc4946b1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.477673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.477853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.478240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.478240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.478240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.478438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.478547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.478594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.478739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.478814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.478909] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 already deleted. [ 867.478991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.504240] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.639936] env[66131]: INFO networking_nsxv3.common.synchronization [None req-65170466-87f6-4462-95c1-4da725f3434c None None] Enqueued Resource ID: 4b54518f-30cb-450a-95a0-f50b3ff0c9a8 with Priority: HIGHEST for action port [ 867.640229] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b54518f-30cb-450a-95a0-f50b3ff0c9a8 with Priority: HIGHEST for action port [ 867.640792] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b54518f-30cb-450a-95a0-f50b3ff0c9a8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.640933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b54518f-30cb-450a-95a0-f50b3ff0c9a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.640991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b54518f-30cb-450a-95a0-f50b3ff0c9a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.641257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b54518f-30cb-450a-95a0-f50b3ff0c9a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.641358] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b54518f-30cb-450a-95a0-f50b3ff0c9a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.946584] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.946913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.947012] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.947263] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.947556] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.947556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port d94f1aa1-42c7-4008-8cc2-557bc4946b1d not found, creating... [ 867.950540] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.950540] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.950540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.950996] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: d94f1aa1-42c7-4008-8cc2-557bc4946b1d is going to be created. [ 867.953284] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.953463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.953564] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.953837] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.954122] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.954294] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.954410] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.954611] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.954745] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.954941] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.955141] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.955261] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.955367] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.955478] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.955580] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.955702] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.977229] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.977975] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.977975] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.977975] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.978252] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-4b455958-495c-4010-a880-0ba4a51684af taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.978395] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.978517] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.979025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.979141] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b455958-495c-4010-a880-0ba4a51684af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.980821] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.980998] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.981125] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.981383] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.982050] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.982050] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.007108] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.007261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.007336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.007548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.007638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.007733] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be created. [ 868.030981] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.031192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.031269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.031504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.031664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.051726] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: UNINITIALIZED for 2s [ 868.143335] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b54518f-30cb-450a-95a0-f50b3ff0c9a8 [ 868.143417] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.143549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.143583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.145225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.145225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.145225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b54518f-30cb-450a-95a0-f50b3ff0c9a8 already deleted. [ 868.145225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b54518f-30cb-450a-95a0-f50b3ff0c9a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.484329] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.484673] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.484673] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.484952] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.485147] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.485309] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 4b455958-495c-4010-a880-0ba4a51684af not found, creating... [ 868.485578] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.485729] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.485844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.486073] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.486215] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.486491] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.486676] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.486796] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.487007] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.487156] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.487294] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 4b455958-495c-4010-a880-0ba4a51684af is going to be created. [ 868.509680] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.509908] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.510067] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.510383] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.510645] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.510878] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.692198] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-076b5db1-3390-4a0e-9782-dafdf1bd5417 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 868.692198] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-076b5db1-3390-4a0e-9782-dafdf1bd5417 service nova] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 868.692357] env[66131]: INFO networking_nsxv3.common.synchronization [req-e8bd2960-908b-4606-bd88-67d2e9170375 req-076b5db1-3390-4a0e-9782-dafdf1bd5417 service nova] Enqueued Resource ID: d94f1aa1-42c7-4008-8cc2-557bc4946b1d with Priority: HIGHEST for action port [ 868.692835] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_rules [ 868.692972] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 868.693109] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94f1aa1-42c7-4008-8cc2-557bc4946b1d with Priority: HIGHEST for action port [ 868.693459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.693514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.693669] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.693780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.693917] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.694047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.694122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.694306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.694393] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94f1aa1-42c7-4008-8cc2-557bc4946b1d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.196855] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d94f1aa1-42c7-4008-8cc2-557bc4946b1d with status ACTIVE [ 869.197142] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.197285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.197353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.197588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.197663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.197824] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.197994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.197994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.198814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.198814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.198814] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.198814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.198814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.198814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.198814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.198814] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d94f1aa1-42c7-4008-8cc2-557bc4946b1d is going to be updated. [ 869.215036] env[66131]: INFO networking_nsxv3.common.synchronization [req-1178883b-cf5a-446f-9f56-38efb6f7f260 req-fcd5a191-8602-4fb9-88e8-bfec61b421da service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 869.215236] env[66131]: INFO networking_nsxv3.common.synchronization [req-1178883b-cf5a-446f-9f56-38efb6f7f260 req-fcd5a191-8602-4fb9-88e8-bfec61b421da service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 869.215360] env[66131]: INFO networking_nsxv3.common.synchronization [req-1178883b-cf5a-446f-9f56-38efb6f7f260 req-fcd5a191-8602-4fb9-88e8-bfec61b421da service nova] Enqueued Resource ID: 4b455958-495c-4010-a880-0ba4a51684af with Priority: HIGHEST for action port [ 869.215920] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 869.215920] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 869.215920] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b455958-495c-4010-a880-0ba4a51684af with Priority: HIGHEST for action port [ 869.216720] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.216720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.216720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.217080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.217080] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.217845] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.217963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.218047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.218215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.218406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.218485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.218528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.219290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.219290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.219290] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.220822] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b455958-495c-4010-a880-0ba4a51684af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.220822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.220822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.220822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.220822] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b455958-495c-4010-a880-0ba4a51684af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.222312] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.222312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.222312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.222534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.222696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.222962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d94f1aa1-42c7-4008-8cc2-557bc4946b1d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.231318] env[66131]: INFO networking_nsxv3.common.synchronization [req-307b2b59-4335-44d0-b11c-448a2e048745 req-fb8beb61-8153-4d65-b30e-e62d2ffb23d4 tempest-ServerRescueTestJSON-1428891184 tempest-ServerRescueTestJSON-1428891184-project-member] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 869.231404] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 869.232024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.232157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.232157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.232445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.232664] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.232821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.233317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.233317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.233317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.233317] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.624866] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.624866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.624866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.625341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.625497] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.625652] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.625781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.625983] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.626135] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.626331] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.626438] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.626541] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.626646] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.626749] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.626853] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.627135] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.647419] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.647589] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.647728] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.647960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.648298] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-e3e2029d-9529-4c68-ac84-67bb1f4c0195 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.648473] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.648592] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.648918] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.649063] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e2029d-9529-4c68-ac84-67bb1f4c0195',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.721754] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.723320] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.723465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.723605] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b455958-495c-4010-a880-0ba4a51684af with status ACTIVE [ 869.723757] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.723857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.723918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.724402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.724402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.724402] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.724540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.724633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.724872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.724872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.725010] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.725218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.725218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.725349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.725420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.726074] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b455958-495c-4010-a880-0ba4a51684af is going to be updated. [ 869.735278] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.735278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.735278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.736244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.736244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.736244] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.736244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.736244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.736244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.736244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.736244] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 already deleted. [ 869.738187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.755213] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.755213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.755213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.755442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.755627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.755792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b455958-495c-4010-a880-0ba4a51684af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.063257] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 870.063903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.063903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.064128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.064317] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.064438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.064501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.064656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.064870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.065032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.065076] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.065894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.066066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.066225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.066326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.066388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.066526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.066602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.066687] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.153633] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.153869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.153994] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.154359] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.154508] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.154661] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port e3e2029d-9529-4c68-ac84-67bb1f4c0195 not found, creating... [ 870.154922] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.155094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.155209] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.155415] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.155547] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.155828] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.155975] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.156115] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.156324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.156449] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.156582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: e3e2029d-9529-4c68-ac84-67bb1f4c0195 is going to be created. [ 870.179916] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.180165] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.180314] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.180611] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.181035] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.181068] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.229060] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.568406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.568546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.568743] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.731441] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.731746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.731746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.731866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.731967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.732105] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be created. [ 870.756778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.756934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.756989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.757222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.757369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.767386] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: UNINITIALIZED for 2s [ 870.904337] env[66131]: INFO networking_nsxv3.common.synchronization [req-307b2b59-4335-44d0-b11c-448a2e048745 req-9f2bc419-f11c-47b8-8364-69521528360d service nova] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_rules [ 870.904511] env[66131]: INFO networking_nsxv3.common.synchronization [req-307b2b59-4335-44d0-b11c-448a2e048745 req-9f2bc419-f11c-47b8-8364-69521528360d service nova] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 870.904647] env[66131]: INFO networking_nsxv3.common.synchronization [req-307b2b59-4335-44d0-b11c-448a2e048745 req-9f2bc419-f11c-47b8-8364-69521528360d service nova] Enqueued Resource ID: e3e2029d-9529-4c68-ac84-67bb1f4c0195 with Priority: HIGHEST for action port [ 870.905173] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_rules [ 870.905309] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 870.905407] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e2029d-9529-4c68-ac84-67bb1f4c0195 with Priority: HIGHEST for action port [ 870.905679] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.906034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.906034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.906403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.906531] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.907444] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.907724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.907835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.908066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.908395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.908551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.908776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.909147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.913019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.913019] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.913019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3e2029d-9529-4c68-ac84-67bb1f4c0195 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.913019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.913019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.913019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.913019] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e2029d-9529-4c68-ac84-67bb1f4c0195',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.072861] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.413926] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.414105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.414316] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3e2029d-9529-4c68-ac84-67bb1f4c0195 with status ACTIVE [ 871.414528] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.414614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.414680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.414877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.414968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.415163] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.415276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.415345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.415532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.415618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.415797] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.415890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.415950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.416108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.416187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.416272] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3e2029d-9529-4c68-ac84-67bb1f4c0195 is going to be updated. [ 871.419527] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.441848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.441848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.441848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.442212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.442333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.442547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3e2029d-9529-4c68-ac84-67bb1f4c0195" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.576436] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.576648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.576718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.576938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.577083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.577209] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 871.618308] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.618495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.618732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.618813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.618951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.634271] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 871.925673] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.222018] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ccea16a4-bc82-4bb8-8fb2-cc56bb159372 None None] Enqueued Resource ID: 75009d06-e627-4d2a-ad74-907c25c98556 with Priority: HIGHEST for action port [ 872.222018] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75009d06-e627-4d2a-ad74-907c25c98556 with Priority: HIGHEST for action port [ 872.222018] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-75009d06-e627-4d2a-ad74-907c25c98556 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.222018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75009d06-e627-4d2a-ad74-907c25c98556" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.222018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75009d06-e627-4d2a-ad74-907c25c98556" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.222892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75009d06-e627-4d2a-ad74-907c25c98556" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.222892] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75009d06-e627-4d2a-ad74-907c25c98556',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.429397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.429476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.429611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.429738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.429858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.429960] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be created. [ 872.459727] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.459727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.459727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.459727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.459727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.476151] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: UNINITIALIZED for 2s [ 872.727089] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75009d06-e627-4d2a-ad74-907c25c98556 [ 872.727335] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.727469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.727540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.727772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.727866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.727958] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75009d06-e627-4d2a-ad74-907c25c98556 already deleted. [ 872.728055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75009d06-e627-4d2a-ad74-907c25c98556" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.778756] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 872.778984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.779177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.779406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.779594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.779731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.779796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.779974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.780067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.780154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.780589] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.282804] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.645700] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 873.648068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.648274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.648507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.648707] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.648829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.648898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.649108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.649185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.649293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.650255] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.650255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.650255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.650255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.650255] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.650255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.650255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.650551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.650551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.650551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.650644] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.661638] env[66131]: INFO networking_nsxv3.common.synchronization [req-de047b21-0d85-4b9a-8db2-65bbdd3bd9c6 req-521def1b-6f68-4221-a589-0ada4989097a tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_members [ 873.663329] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGHEST for action security_group_members [ 873.663329] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.663329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.663329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.663329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.663566] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.663566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.663566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.663710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.663792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.663883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.788194] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30740e8f-2016-47cb-9949-af7efd303581: rpc.has_security_group_logging(os_id): False [ 873.807823] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.807823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.807823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.807823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.808122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.808158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.808268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.808328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.808480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.808556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.808650] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be created. [ 873.876092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.876270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.876315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.878341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.878341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.892547] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 874.152788] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f876b0-0618-417d-b11e-0e430c4a1630: rpc.has_security_group_logging(os_id): False [ 874.170013] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.170264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.170340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.171022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.173511] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.173720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.195663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.195919] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.196054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.196122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.196357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.196426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.198295] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 is going to be updated. [ 874.198295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.198295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.198295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.198295] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.198295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.198295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.198295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.198580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.198580] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.198709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.198709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.198799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.198889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.199098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.199185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.199774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.199774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.199774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.199774] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be created. [ 874.228214] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.230937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.230937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.230937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.230937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.238742] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: IN_PROGRESS for 2s [ 874.296308] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.296308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.296308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.296308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.296308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.333643] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 874.489325] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 874.489576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.489749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.490022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.490228] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.490357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.490424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.490608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.490694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.490797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.490893] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.995756] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.995949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.996167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.996290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.996437] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.996539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.996663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.996881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.996881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.996992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.997052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.997151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.997222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.997578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.997578] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.997578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.997578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.998101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.998101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.998101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.998101] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.047528] env[66131]: INFO networking_nsxv3.common.synchronization [None req-bf80307a-100f-49e3-ba36-0ba6a91437ef tempest-ServersV294TestFqdnHostnames-31794505 tempest-ServersV294TestFqdnHostnames-31794505-project-member] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_rules [ 875.048193] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_rules [ 875.048395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.048512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.048577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.052401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.052539] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.147190] env[66131]: INFO networking_nsxv3.common.synchronization [None req-77a9a830-c24b-456a-934a-eab2cc37c4d1 tempest-ServersV294TestFqdnHostnames-31794505 tempest-ServersV294TestFqdnHostnames-31794505-project-member] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_rules [ 875.147893] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_rules [ 875.148059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.148165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.503693] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d77f610-439c-48b3-8ae3-c867ae6ba8f2: rpc.has_security_group_logging(os_id): False [ 875.524173] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.524173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.524173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.524414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.524550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.524783] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.524864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.524950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.525123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.525214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.525457] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.525592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.525592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.525711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.525785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.525965] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.526072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.526130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.526299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.527273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.527273] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be created. [ 875.614221] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.614421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.614421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.617094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.617267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.617384] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 already deleted. [ 875.617478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.617887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.617887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.617952] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.628759] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.628931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.628990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.629220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.629406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.644420] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: IN_PROGRESS for 2s [ 875.924028] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 875.924028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.990984] env[66131]: INFO networking_nsxv3.common.synchronization [None req-01ae22ea-421f-4c7d-9224-50768bd7215b None None] Enqueued Resource ID: 1aba4d28-ce95-4453-9340-ed75630eb7c0 with Priority: HIGHEST for action port [ 875.991716] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aba4d28-ce95-4453-9340-ed75630eb7c0 with Priority: HIGHEST for action port [ 875.993175] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aba4d28-ce95-4453-9340-ed75630eb7c0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.993175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aba4d28-ce95-4453-9340-ed75630eb7c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.993175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aba4d28-ce95-4453-9340-ed75630eb7c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.993175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aba4d28-ce95-4453-9340-ed75630eb7c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.993175] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aba4d28-ce95-4453-9340-ed75630eb7c0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.143090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.143371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.143473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.143732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.143847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.143981] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 already deleted. [ 876.144326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.252666] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 in Status: SUCCESS [ 876.252879] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 deletion is rescheduled due to dependency. [ 876.253024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.351740] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 876.352231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.352595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.352978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.353208] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.495220] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aba4d28-ce95-4453-9340-ed75630eb7c0 [ 876.495618] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.497039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.497039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.500226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.500582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.500635] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aba4d28-ce95-4453-9340-ed75630eb7c0 already deleted. [ 876.500764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aba4d28-ce95-4453-9340-ed75630eb7c0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.858166] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.858166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.858166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.858166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.858166] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.858166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.858166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.858836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.858836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.858836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.858836] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.362465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.362740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.364025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.364025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.364025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.364025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.364025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.364514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.364643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.365662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.366582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.369022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.369022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.369022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.369022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.369022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.369022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.372435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.372580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.372696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.372778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.613941] env[66131]: INFO networking_nsxv3.common.synchronization [req-09c5460c-e30c-40ad-a3dc-0b9d56290272 req-907f6c15-5a77-4f3b-b7de-16c4f35201a7 tempest-ListImageFiltersTestJSON-907682754 tempest-ListImageFiltersTestJSON-907682754-project-member] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 877.614580] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGHEST for action security_group_members [ 877.614899] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.615102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.615194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.615399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.615706] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.615837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.615837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.616045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.616175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.616279] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.657479] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 877.657804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.878600] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6f876b0-0618-417d-b11e-0e430c4a1630: rpc.has_security_group_logging(os_id): False [ 877.903804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.904058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.904240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.904826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.905042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.905406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.905624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.905690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.907154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.907154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.907154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.907154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.907154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.907154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.907154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.907400] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.907400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.907400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.907500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.907715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.907860] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 878.007541] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.007746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.007827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.008055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.008211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.029917] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 878.119594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.119858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.119858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.120259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.124944] env[66131]: INFO networking_nsxv3.common.synchronization [req-b95e4082-be2c-4855-9598-f921b71c9644 req-60eadbe5-509f-49bf-82b4-2bfcfa896179 tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 878.126452] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 878.130451] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.130674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.130745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.132181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.132181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.132181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.132181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.132410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.132410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.132473] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.154329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.154553] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.154681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.154771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.154974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.155070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.155161] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be updated. [ 878.193443] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.193640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.193745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.194146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.194326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.210998] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: IN_PROGRESS for 2s [ 878.449208] env[66131]: INFO networking_nsxv3.common.synchronization [req-dc9b52b7-35b8-4492-8558-a62c8403d20e req-f959004f-72aa-45a7-b4bb-f3140f162e53 tempest-ListServerFiltersTestJSON-1463311190 tempest-ListServerFiltersTestJSON-1463311190-project-member] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 878.450026] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGHEST for action security_group_members [ 878.450026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.450026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.450026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.451717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.451905] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.452555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.452647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.452846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.452962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.453049] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.579311] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.579866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.579942] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.580574] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.581067] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.581523] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.581772] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.582201] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.582411] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.582730] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.585679] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.585679] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.585679] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.585679] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.585679] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.585679] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.607097] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.607097] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.607426] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.607512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-405" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.607899] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-670491e2-a404-4a2b-9f17-4deb4fb46a6e taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.608102] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.608239] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.608581] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.608711] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('670491e2-a404-4a2b-9f17-4deb4fb46a6e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.635231] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.635565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.635565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.635780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.657511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.657765] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.657883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.658012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.658198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.658288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.658382] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 878.699965] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.700193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.700233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.701019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.701019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.710403] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 878.955391] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.955721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.955721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.955794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.989880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.989880] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.989880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.989880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.990253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.990253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.990334] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be updated. [ 879.027755] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.027755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.027755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.027755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.027755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.041754] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: IN_PROGRESS for 2s [ 879.111956] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.112302] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.112489] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.112878] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.113106] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.113470] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 670491e2-a404-4a2b-9f17-4deb4fb46a6e not found, creating... [ 879.113853] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.114066] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.114454] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.114974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.115627] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.115876] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.115876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.115995] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.116296] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.116515] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.116625] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 670491e2-a404-4a2b-9f17-4deb4fb46a6e is going to be created. [ 879.143993] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.144318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.144318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.145028] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.145125] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.146031] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.929767] env[66131]: INFO networking_nsxv3.common.synchronization [req-b95e4082-be2c-4855-9598-f921b71c9644 req-daad4808-3f61-4d1c-8342-03462b543906 service nova] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_rules [ 879.929767] env[66131]: INFO networking_nsxv3.common.synchronization [req-b95e4082-be2c-4855-9598-f921b71c9644 req-daad4808-3f61-4d1c-8342-03462b543906 service nova] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 879.929951] env[66131]: INFO networking_nsxv3.common.synchronization [req-b95e4082-be2c-4855-9598-f921b71c9644 req-daad4808-3f61-4d1c-8342-03462b543906 service nova] Enqueued Resource ID: 670491e2-a404-4a2b-9f17-4deb4fb46a6e with Priority: HIGHEST for action port [ 879.933403] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_rules [ 879.933601] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 879.933744] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670491e2-a404-4a2b-9f17-4deb4fb46a6e with Priority: HIGHEST for action port [ 879.934212] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.934328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.934416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.934680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.934806] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.935829] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.935934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.936139] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-670491e2-a404-4a2b-9f17-4deb4fb46a6e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.936243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.936305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.936482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.936556] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('670491e2-a404-4a2b-9f17-4deb4fb46a6e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.085437] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 880.086028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.223072] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f in Status: SUCCESS [ 880.225095] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f deletion is rescheduled due to dependency. [ 880.225095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.442157] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.442303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.442523] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 670491e2-a404-4a2b-9f17-4deb4fb46a6e with status ACTIVE [ 880.442716] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.442909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.442909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.443198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.443309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.443546] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.443885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.443984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.444248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.444414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.444607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.444722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.444791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.445089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.445089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.445352] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 670491e2-a404-4a2b-9f17-4deb4fb46a6e is going to be updated. [ 880.477826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.477826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.477826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.478099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.478212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.478401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-670491e2-a404-4a2b-9f17-4deb4fb46a6e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 880.723333] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 deletion is rescheduled due to dependency. [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.723333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.723333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723842] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.886872] env[66131]: INFO networking_nsxv3.common.synchronization [req-23f2dfd9-811f-4f93-b0b4-33a1b58af8c5 req-d3416cca-eac8-49b0-961a-6dbf957bf8f0 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 880.886983] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 880.887416] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.887524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.887524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.887872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.887872] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.887985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.887985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.888347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.888481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.888581] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.055653] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 in Status: SUCCESS [ 881.055851] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 deletion is rescheduled due to dependency. [ 881.057133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.227819] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.293182] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.293182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.293182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.293182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.293491] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.293974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.294528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.294972] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.295409] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.296074] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.297221] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.297373] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.297465] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.297605] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.299742] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.299742] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.324227] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.324606] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.324606] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.324782] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.325135] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-81d9ab26-3257-4375-af69-7329177f2718 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.325333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.325459] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.325860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.326014] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d9ab26-3257-4375-af69-7329177f2718',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.391716] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.729759] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.829047] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.829288] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.829457] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.830629] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.830795] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.830955] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 81d9ab26-3257-4375-af69-7329177f2718 not found, creating... [ 881.831286] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.831475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.831599] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.831846] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.831984] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.832335] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.832559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.832772] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.833036] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.835721] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.835721] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 81d9ab26-3257-4375-af69-7329177f2718 is going to be created. [ 881.858053] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.858053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.858053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.858053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.858053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.858053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.894614] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.234823] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.235275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.237379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.237796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.237992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.238179] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 882.278150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.278482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.278747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.279158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.279478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.295508] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 882.397688] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.397688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.397688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.398068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.398068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.399611] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 882.428493] env[66131]: INFO networking_nsxv3.common.synchronization [req-df47f908-ea9c-469d-ac83-e7f0af115eef req-dbe63840-78c7-478b-a1b2-fabc5c3df5f0 tempest-ServersWithSpecificFlavorTestJSON-1087626551 tempest-ServersWithSpecificFlavorTestJSON-1087626551-project-member] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 882.429056] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGHEST for action security_group_members [ 882.429368] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.429508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.430860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.431095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.431275] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.431592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.431592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.431592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.431696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.431763] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.439589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.439778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.439778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.440715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.440715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.460635] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 882.664923] env[66131]: INFO networking_nsxv3.common.synchronization [req-23f2dfd9-811f-4f93-b0b4-33a1b58af8c5 req-dbf1ff65-ef8c-425b-a65f-84f2b4c74816 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 882.665076] env[66131]: INFO networking_nsxv3.common.synchronization [req-23f2dfd9-811f-4f93-b0b4-33a1b58af8c5 req-dbf1ff65-ef8c-425b-a65f-84f2b4c74816 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 882.665132] env[66131]: INFO networking_nsxv3.common.synchronization [req-23f2dfd9-811f-4f93-b0b4-33a1b58af8c5 req-dbf1ff65-ef8c-425b-a65f-84f2b4c74816 service nova] Enqueued Resource ID: 81d9ab26-3257-4375-af69-7329177f2718 with Priority: HIGHEST for action port [ 882.665639] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 882.665777] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 882.666298] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81d9ab26-3257-4375-af69-7329177f2718 with Priority: HIGHEST for action port [ 882.666634] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.666735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.666807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.667037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.667129] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.668060] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.668152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.668376] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-81d9ab26-3257-4375-af69-7329177f2718 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.668510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.668560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.668711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.669109] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d9ab26-3257-4375-af69-7329177f2718',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.939509] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.939509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.939509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.939963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.973906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.974382] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.974698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.974776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.975587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.975587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.975587] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be updated. [ 883.020315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.020522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.020602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.020832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.020979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.031550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: IN_PROGRESS for 2s [ 883.171233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.171394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.171597] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81d9ab26-3257-4375-af69-7329177f2718 with status ACTIVE [ 883.171782] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.171891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.171971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.172190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.172281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.172456] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.172557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.172612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.172754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.172831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.173015] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.173118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.173231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.173352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.173428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.173513] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81d9ab26-3257-4375-af69-7329177f2718 is going to be updated. [ 883.201545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.201701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.201774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.201995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.202161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.202346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81d9ab26-3257-4375-af69-7329177f2718" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.848206] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 883.848206] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_members [ 883.848206] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 883.848206] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_members [ 883.848206] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.848206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.848206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.849547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.851039] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.851039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.851039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.853418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.853675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.853922] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.855181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c0c29e-35e0-489c-b22b-6a4186cc1542 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.856885] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.856885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.856885] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.897068] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_rules [ 883.897263] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 883.897405] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_rules [ 883.897602] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_members [ 883.897668] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc253a79-a906-41f8-97f7-789bfbe75d7c req-b1627118-920f-447a-93c0-8e0c364238a1 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 with Priority: HIGHEST for action port [ 883.898221] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_rules [ 883.898365] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_rules [ 883.898459] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 with Priority: HIGHEST for action port [ 883.898547] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 883.898640] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_members [ 883.899161] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.899288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.899573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.899679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.899782] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.900663] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67c0c29e-35e0-489c-b22b-6a4186cc1542 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.900798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.900878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.901534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.905028] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.905028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-205d637e-51bb-4eef-b0b7-f8620d0e6035 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.905028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.905028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.905028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.905028] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205d637e-51bb-4eef-b0b7-f8620d0e6035',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.905028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.905028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.905028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c0c29e-35e0-489c-b22b-6a4186cc1542 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.905028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.310811] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 884.310811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.311067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.311332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.311956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.311956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.311956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.311956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.312274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.312274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.312274] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.358276] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.359763] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.406031] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.406197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.407871] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c0c29e-35e0-489c-b22b-6a4186cc1542 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.408066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.408255] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 205d637e-51bb-4eef-b0b7-f8620d0e6035 with status ACTIVE [ 884.409164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.409164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.409164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.409164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.409164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.409164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.409164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.409460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.409460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.409460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.410245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.410245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.410245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.410245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.410245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.410245] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 is going to be updated. [ 884.430732] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.430888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.430939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.431202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.431363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.431539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.474996] env[66131]: INFO networking_nsxv3.common.synchronization [req-4fbc6455-a654-408d-b7ce-d3d674e05d54 req-2941edd3-07e3-48a6-bba4-921ca19d531a tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 884.475197] env[66131]: INFO networking_nsxv3.common.synchronization [req-4fbc6455-a654-408d-b7ce-d3d674e05d54 req-2941edd3-07e3-48a6-bba4-921ca19d531a tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_members [ 884.476405] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 884.476615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.477327] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 884.477327] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 with Priority: HIGHEST for action security_group_members [ 884.477653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.477864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.478200] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.478510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.478510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.478607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.479067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.479067] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.480292] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.480397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.480603] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c0c29e-35e0-489c-b22b-6a4186cc1542 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.480790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.547896] env[66131]: INFO networking_nsxv3.common.synchronization [req-4fbc6455-a654-408d-b7ce-d3d674e05d54 req-2941edd3-07e3-48a6-bba4-921ca19d531a tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_rules [ 884.550720] env[66131]: INFO networking_nsxv3.common.synchronization [req-4fbc6455-a654-408d-b7ce-d3d674e05d54 req-2941edd3-07e3-48a6-bba4-921ca19d531a tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 884.552362] env[66131]: INFO networking_nsxv3.common.synchronization [req-4fbc6455-a654-408d-b7ce-d3d674e05d54 req-2941edd3-07e3-48a6-bba4-921ca19d531a tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 with Priority: HIGHEST for action port [ 884.552800] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_rules [ 884.552993] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 884.553111] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 with Priority: HIGHEST for action port [ 884.553527] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.553678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.553913] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.554031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.554243] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-205d637e-51bb-4eef-b0b7-f8620d0e6035 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.554373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.554441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.554676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.554782] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205d637e-51bb-4eef-b0b7-f8620d0e6035',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.814870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.815059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.815207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.815431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.815762] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.816156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.816244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.816407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.816532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.816663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.816835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.816934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.816996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.817166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.817303] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.817411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.817441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.817669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.817747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.817828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.817917] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.864669] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.865603] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.981070] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.989507] env[66131]: INFO networking_nsxv3.common.synchronization [req-380a13bf-82ef-4670-97ee-5efcb753245e req-c3216bf4-00f9-4cc2-869e-88ae1d2f8625 tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 884.989691] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 884.989980] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.990115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.990192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.990377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.991996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.991996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.991996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.991996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.991996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.991996] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.051569] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f in Status: SUCCESS [ 885.051823] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f deletion is rescheduled due to dependency. [ 885.051937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.059510] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 205d637e-51bb-4eef-b0b7-f8620d0e6035 with status ACTIVE [ 885.059868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.060088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.060205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.060526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.060669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.060947] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.064025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.064025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.064025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 205d637e-51bb-4eef-b0b7-f8620d0e6035 is going to be updated. [ 885.090094] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.090282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.090394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.090771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.091012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.091248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-205d637e-51bb-4eef-b0b7-f8620d0e6035" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.239658] env[66131]: INFO networking_nsxv3.common.synchronization [req-380a13bf-82ef-4670-97ee-5efcb753245e req-3e4eead7-6965-485b-a39f-2eadef639e9f tempest-ServersTestMultiNic-1904438599 tempest-ServersTestMultiNic-1904438599-project-member] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 885.240679] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGHEST for action security_group_members [ 885.241210] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.241463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.323034] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395c7bb1-0365-458d-a01e-64a431cc84a0: rpc.has_security_group_logging(os_id): False [ 885.347713] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.347932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.347995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.348259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.348359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.348574] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.348703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.348746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.348911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.348995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.349282] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.349406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.349503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.349631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.349703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.349964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.350110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.350194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.350411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.350528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.350633] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 885.368042] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.368482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.368592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.368961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.369127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.369199] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be updated. [ 885.371240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.371240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.371240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.371893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.372861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.372861] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 is going to be created. [ 885.417358] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.417358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.417358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.417672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.417672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.420109] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.420109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.420109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.420109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.420109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.433596] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 885.435158] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 in Status: UNINITIALIZED for 2s [ 885.443019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.443019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.443019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.443019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.443019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.469233] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 885.483755] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.493337] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.932995] env[66131]: INFO networking_nsxv3.common.synchronization [req-56c1b77a-964d-4453-84e6-547b6cbc6542 req-9819d368-8b2f-4d25-8f10-a43a55c70741 tempest-ServersTestFqdnHostnames-1386842827 tempest-ServersTestFqdnHostnames-1386842827-project-member] Enqueued Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_members [ 885.933843] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_members [ 885.934404] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.934587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.934683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.934980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.935260] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.935412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.935659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.936056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.936199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.936333] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.991324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.991422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.991457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.991689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.991797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.991906] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 885.997733] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.052368] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.052548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.052585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.052806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.052998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.064467] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 886.374089] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.375109] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-812" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.375109] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-812" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.375109] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-812" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.375535] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.375787] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.375973] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.376692] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.379452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.379452] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.379452] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.379452] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.379452] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.379452] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.379452] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.379452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.405075] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.405379] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.405640] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.406627] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-812" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.406627] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-581aa6e7-b070-47b0-ada6-fc0956465ce5 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.406806] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.407251] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.407860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.408512] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('581aa6e7-b070-47b0-ada6-fc0956465ce5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.439356] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.439508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.439578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.440577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.440577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.440808] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.440808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.440808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.441126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.441126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.441126] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef72789-9405-4544-841f-1905c2771a0d already deleted. [ 886.441233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.502554] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.502742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.502827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.503055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.503147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.503314] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 886.533906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.534147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.534193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.534369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.544329] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 886.607009] env[66131]: INFO networking_nsxv3.common.synchronization [req-945dc86c-5fd4-4d6e-afa8-76c9f1aa79a1 req-eef71bc4-a31b-4f8d-9d84-04e3f6723d70 tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 886.608234] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 886.608733] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.608892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.608974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.609180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.609367] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.609461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.609495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.609626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.609714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.609808] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.911118] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.911384] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.911520] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.911781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.911953] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.912117] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 581aa6e7-b070-47b0-ada6-fc0956465ce5 not found, creating... [ 886.912379] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.912528] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.912640] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.912871] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.913014] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.913352] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.913547] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.913674] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.913875] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.916019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.916019] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 581aa6e7-b070-47b0-ada6-fc0956465ce5 is going to be created. [ 886.939929] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.940369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.940369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.940662] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.940902] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.941154] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.113034] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.445152] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 in Status: SUCCESS [ 887.445357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.445539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.445783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.446816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.446816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.446816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.446816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.446816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.446816] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.448262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 887.448454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.448608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.448804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.448984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.449103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.449162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.449325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.449411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.449530] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.492068] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 887.492068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.616805] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.705230] env[66131]: INFO networking_nsxv3.common.synchronization [req-56c1b77a-964d-4453-84e6-547b6cbc6542 req-926cbd7d-e37e-471f-9d05-92255b577646 service nova] Enqueued Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_rules [ 887.705432] env[66131]: INFO networking_nsxv3.common.synchronization [req-56c1b77a-964d-4453-84e6-547b6cbc6542 req-926cbd7d-e37e-471f-9d05-92255b577646 service nova] Enqueued Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_members [ 887.705572] env[66131]: INFO networking_nsxv3.common.synchronization [req-56c1b77a-964d-4453-84e6-547b6cbc6542 req-926cbd7d-e37e-471f-9d05-92255b577646 service nova] Enqueued Resource ID: 581aa6e7-b070-47b0-ada6-fc0956465ce5 with Priority: HIGHEST for action port [ 887.706141] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_rules [ 887.706286] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_members [ 887.706382] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 581aa6e7-b070-47b0-ada6-fc0956465ce5 with Priority: HIGHEST for action port [ 887.706730] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.706877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.706938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.707323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.707444] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.708847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.709167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.709167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.709369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.709556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.709707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.709794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.710015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.710446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.710446] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.711479] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-581aa6e7-b070-47b0-ada6-fc0956465ce5 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.711653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.711653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.711886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.713065] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('581aa6e7-b070-47b0-ada6-fc0956465ce5',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.951226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.951584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.951584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.952662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.952886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.953143] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.953302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.953362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.953798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.953798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.953798] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 is going to be deleted. [ 887.954825] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.000547] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.000709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.000788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.001038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.001162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.001249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.001432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.001623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.001797] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.001899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.001960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.002125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.002206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.002304] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.079230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 888.079530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.079714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.079955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.080158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.080291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.080350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.080623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.080740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.080847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.080945] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.119521] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.119738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.119738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.120042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.120175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.120277] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 888.166884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.167109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.167168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.167410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.167578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.179620] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 888.215186] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.217286] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.217426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.217598] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 581aa6e7-b070-47b0-ada6-fc0956465ce5 with status ACTIVE [ 888.218377] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.218377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.218377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.218377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.218377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.218739] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.218739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.218739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.220120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.220264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220541] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.220692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.220749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.220924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.221013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.221150] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 581aa6e7-b070-47b0-ada6-fc0956465ce5 is going to be updated. [ 888.260836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.261267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.261267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.262071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.262071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.262071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-581aa6e7-b070-47b0-ada6-fc0956465ce5" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.462104] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.464754] env[66131]: INFO networking_nsxv3.common.synchronization [req-2274cde8-ca60-46bc-bb2d-3f663c6ce6ff req-0dd792a3-a524-49e8-89bc-f83f7322bd8f tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 888.464754] env[66131]: INFO networking_nsxv3.common.synchronization [req-2274cde8-ca60-46bc-bb2d-3f663c6ce6ff req-0dd792a3-a524-49e8-89bc-f83f7322bd8f tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 888.464754] env[66131]: INFO networking_nsxv3.common.synchronization [req-2274cde8-ca60-46bc-bb2d-3f663c6ce6ff req-0dd792a3-a524-49e8-89bc-f83f7322bd8f tempest-SecurityGroupsTestJSON-635254608 tempest-SecurityGroupsTestJSON-635254608-project-member] Enqueued Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_members [ 888.464754] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGHEST for action security_group_members [ 888.465034] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 with Priority: HIGHEST for action security_group_members [ 888.465034] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 with Priority: HIGHEST for action security_group_members [ 888.465431] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.465932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.469047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.469326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.469561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.469703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.469760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.469906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.469995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.470108] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.471133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-4320e0f3-4bbc-42b2-999c-7e766e099226 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.471259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.471325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.471477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.471709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.471823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.471913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.472099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.472187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.472280] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4320e0f3-4bbc-42b2-999c-7e766e099226',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.475054] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3724e928-c7a7-4c1d-a230-ec565cc9eb94 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.475054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.475054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.475238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.475271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.475417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.475417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.475568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.475656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.475751] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3724e928-c7a7-4c1d-a230-ec565cc9eb94',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.505671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.505769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.505912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.506101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.506198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.506405] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.506523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.506591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.506718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.506796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.506877] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 already deleted. [ 888.506984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.507064] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.507903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.508097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.508493] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.508493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.508493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.508697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.508770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.508860] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.554674] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 888.555025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.555133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.559029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.559029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.559029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.559029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.559029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.559029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.559029] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.583661] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.584029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.584029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.584228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.584370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.587137] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.587137] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.587137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.587137] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.723574] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.965970] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.966259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.966259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.967035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.967035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.967035] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be updated. [ 888.978804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.979075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.979193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.979608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.983865] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.983865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.983865] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.983865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.003160] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.003348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.003425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.003682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.003806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.005690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.005927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.006054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.006124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.006319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.006451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.006573] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 is going to be updated. [ 889.008024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.008155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.011192] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67c0c29e-35e0-489c-b22b-6a4186cc1542',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.012487] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.013267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.019748] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 889.027860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.028140] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.028260] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.028329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.028516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.028597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.028687] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 is going to be updated. [ 889.029631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.029804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.029931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.030087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.030189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.030252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.030394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.030489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.030579] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be updated. [ 889.031657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.031819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.031901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.032096] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.032197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.032258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.032398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.032476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.032556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 already deleted. [ 889.032636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.035124] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.035256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.035318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.035523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.035669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.045189] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: IN_PROGRESS for 2s [ 889.058702] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.058882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.058968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.060019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.060019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.060019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.060019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.060019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.060019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.060019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.060019] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be updated. [ 889.066989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.067297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.067385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.067597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.067744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.069545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.069685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.069716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.069879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.069997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.079856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: IN_PROGRESS for 2s [ 889.080800] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: IN_PROGRESS for 2s [ 889.091798] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4e8c15-6df2-42fb-824c-bb556c5b499a: rpc.has_security_group_logging(os_id): False [ 889.093755] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.093940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.093993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.094189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.094331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.107197] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: IN_PROGRESS for 2s [ 889.114766] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.114921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.115063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.115359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.135705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.135965] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.136101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.136172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.136382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.136466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.136667] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.136828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.136828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.136988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.137065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.137253] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.137453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.137521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.137666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.137767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.137859] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 889.211421] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.211653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.211712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.211957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.212230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.227019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.227019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.227019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.227019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.227019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.227019] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef72789-9405-4544-841f-1905c2771a0d is going to be created. [ 889.236907] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 889.257316] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.257511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.257581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.257845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.258050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.293254] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef72789-9405-4544-841f-1905c2771a0d in Status: UNINITIALIZED for 2s [ 889.515928] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67c0c29e-35e0-489c-b22b-6a4186cc1542: rpc.has_security_group_logging(os_id): False [ 889.546611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.546936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.547050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.547809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.547809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.547809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.547809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.547809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.548066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.548066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.548125] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 is going to be created. [ 889.575841] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/67c0c29e-35e0-489c-b22b-6a4186cc1542], does not exist path=[/infra/domains/default/groups/67c0c29e-35e0-489c-b22b-6a4186cc1542]."\n}' [ 889.576146] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67c0c29e-35e0-489c-b22b-6a4186cc1542 [ 889.576304] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 889.623653] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.624053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.624135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.624391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.625656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.626046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.626176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.626248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.626541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.626541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.626748] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.626878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.626998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.627134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.627243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.627364] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c0c29e-35e0-489c-b22b-6a4186cc1542 is going to be created. [ 889.653163] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/67c0c29e-35e0-489c-b22b-6a4186cc1542], does not exist path=[/infra/domains/default/groups/67c0c29e-35e0-489c-b22b-6a4186cc1542]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67c0c29e-35e0-489c-b22b-6a4186cc1542 [ 889.653527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67c0c29e-35e0-489c-b22b-6a4186cc1542" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.653873] env[66131]: Traceback (most recent call last): [ 889.653873] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 889.653873] env[66131]: return func(*args, **kwargs) [ 889.653873] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 889.653873] env[66131]: res.raise_for_status() [ 889.653873] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 889.653873] env[66131]: raise HTTPError(http_error_msg, response=self) [ 889.653873] env[66131]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67c0c29e-35e0-489c-b22b-6a4186cc1542 [ 889.653873] env[66131]: During handling of the above exception, another exception occurred: [ 889.653873] env[66131]: Traceback (most recent call last): [ 889.653873] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 889.653873] env[66131]: listener.cb(fileno) [ 889.653873] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 889.653873] env[66131]: result = function(*args, **kwargs) [ 889.653873] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 889.653873] env[66131]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 889.653873] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 889.653873] env[66131]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 889.653873] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 889.653873] env[66131]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 889.653873] env[66131]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 889.653873] env[66131]: res.raise_for_status() [ 889.653873] env[66131]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 889.653873] env[66131]: raise HTTPError(http_error_msg, response=self) [ 889.653873] env[66131]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/67c0c29e-35e0-489c-b22b-6a4186cc1542 [ 889.653873] env[66131]: Removing descriptor: 13 [ 890.192683] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 890.193093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.035571] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 891.035643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.035844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.036128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.036369] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.036509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.036572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.036808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.036900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.036990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.037110] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.038217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.038950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.038950] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.038950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.038950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.038950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.039301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.039301] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.055528] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 in Status: SUCCESS [ 891.055528] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3724e928-c7a7-4c1d-a230-ec565cc9eb94 deletion is rescheduled due to dependency. [ 891.055528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3724e928-c7a7-4c1d-a230-ec565cc9eb94" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.091774] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad174bf4-cd31-47d0-b677-2a143083800a in Status: SUCCESS [ 891.091774] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad174bf4-cd31-47d0-b677-2a143083800a deletion is rescheduled due to dependency. [ 891.091774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.092539] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 in Status: SUCCESS [ 891.092688] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4320e0f3-4bbc-42b2-999c-7e766e099226 deletion is rescheduled due to dependency. [ 891.092769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4320e0f3-4bbc-42b2-999c-7e766e099226" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.119818] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6f876b0-0618-417d-b11e-0e430c4a1630 in Status: SUCCESS [ 891.120152] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 deletion is rescheduled due to dependency. [ 891.120391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.254994] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 891.255308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.305252] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef72789-9405-4544-841f-1905c2771a0d in Status: SUCCESS [ 891.305530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.305787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.306163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.306503] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.306673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.306806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.306959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.307057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.307199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.307415] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.541215] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.541541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.541597] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.576038] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-a09b612a-9124-4d56-9eac-f55352e10c21 tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 891.577254] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 891.577254] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.577254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.577254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.577254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.577541] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.577541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.577541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.577685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.577685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.577822] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.810417] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.000318] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.000318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.000318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.000318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.000318] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.000318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.000318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.000961] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.001308] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.001686] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.001906] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.002110] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.002304] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.002489] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.002670] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.002886] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.023925] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.023925] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.023925] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.023925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.023925] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-0b4e8180-4ad0-4d56-8a95-8f1912399000 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.023925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.024598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.025368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.026110] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b4e8180-4ad0-4d56-8a95-8f1912399000',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.045471] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.082586] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.082783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.082814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.083356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.083552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.083779] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.083928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.084043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.084286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.084354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.084456] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 already deleted. [ 892.084572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.316874] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eef72789-9405-4544-841f-1905c2771a0d: rpc.has_security_group_logging(os_id): False [ 892.339112] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.339279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.339341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.339565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.339657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.339906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.340014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.340078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.340235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.340342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.340390] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eef72789-9405-4544-841f-1905c2771a0d is going to be created. [ 892.428870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.429105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.429216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.429539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.429803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.445582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef72789-9405-4544-841f-1905c2771a0d in Status: IN_PROGRESS for 2s [ 892.529431] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.529775] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.529947] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.530289] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.530455] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.530622] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 0b4e8180-4ad0-4d56-8a95-8f1912399000 not found, creating... [ 892.531067] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.531609] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.531609] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.531609] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.531728] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.532344] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.532581] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.532765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.533074] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.533320] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.533521] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 0b4e8180-4ad0-4d56-8a95-8f1912399000 is going to be created. [ 892.546745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.546928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.546974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.547210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.547315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.547402] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be updated. [ 892.566672] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.566948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.567084] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.567383] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.567700] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.567938] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.595448] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.595750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.595817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.596160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.596561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.609436] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 893.293126] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-d0930d22-7e63-4d16-92e0-9074f72e49d9 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 893.296023] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-d0930d22-7e63-4d16-92e0-9074f72e49d9 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 893.296023] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-d0930d22-7e63-4d16-92e0-9074f72e49d9 service nova] Enqueued Resource ID: 0b4e8180-4ad0-4d56-8a95-8f1912399000 with Priority: HIGHEST for action port [ 893.296023] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 893.296023] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 893.296023] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b4e8180-4ad0-4d56-8a95-8f1912399000 with Priority: HIGHEST for action port [ 893.296023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.296023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.296023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.296023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.296023] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.297167] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.297282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.297453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.299691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.299691] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.299691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b4e8180-4ad0-4d56-8a95-8f1912399000 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.299691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.301942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.301942] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b4e8180-4ad0-4d56-8a95-8f1912399000',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.801993] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.803207] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.803399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.803722] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b4e8180-4ad0-4d56-8a95-8f1912399000 with status ACTIVE [ 893.803974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.804145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.804145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.804302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.804379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.804553] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.804646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.804708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.804863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.804949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.805664] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.805823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.806168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.806168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.806168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.806304] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b4e8180-4ad0-4d56-8a95-8f1912399000 is going to be updated. [ 893.829949] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.830117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.830216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.830511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.830683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.830839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b4e8180-4ad0-4d56-8a95-8f1912399000" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.965135] env[66131]: INFO networking_nsxv3.common.synchronization [req-2296f844-5675-4d93-9835-bfde7fc7c66c req-fca9457f-ed8e-4521-96ed-25c15688a9ba tempest-ImagesOneServerNegativeTestJSON-233693430 tempest-ImagesOneServerNegativeTestJSON-233693430-project-member] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 893.965783] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGHEST for action security_group_members [ 893.970220] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.970220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.970220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.970220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.970220] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.970536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.970622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.970785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.970868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.970972] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.304637] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.463435] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eef72789-9405-4544-841f-1905c2771a0d in Status: SUCCESS [ 894.463682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.474365] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.474549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.474622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.474840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.497384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.498110] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.498110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.498110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.498110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.500713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.500713] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be updated. [ 894.533509] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.533667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.533739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.533969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.534133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.544261] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: IN_PROGRESS for 2s [ 894.618822] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 894.619037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.619188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.619422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.619621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.619741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.619807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.619971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.620075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.620182] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.762664] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-d69f4363-e44a-4743-af29-41e1fb9d7e36 tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 894.763740] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 894.764071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.764192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.807715] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.807715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.807715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.808242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.808242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.808242] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be created. [ 894.833691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.833881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.833925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.834138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.834308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.846293] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: UNINITIALIZED for 2s [ 895.089989] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.091542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.093293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.093293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.093293] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.093293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.093293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.093293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.093293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.093687] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.093687] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.093687] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.093789] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.093826] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.094064] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.094064] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.115054] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.115237] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.115467] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.115650] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.115977] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.116164] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.116285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.116702] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.116844] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e4d1f6-d89a-4b3d-a976-050eeaa3e316',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.122712] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.619522] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.619810] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.620017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.620414] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.620607] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.620835] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 not found, creating... [ 895.621217] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.621440] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.621587] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.621867] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.622057] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.622469] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.622710] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.622846] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.623138] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.623233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.623452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 is going to be created. [ 895.624666] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.651033] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.651033] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.651033] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.651033] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.651396] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.651686] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.129975] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.129975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.129975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.129975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.129975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.129975] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be updated. [ 896.174267] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.174267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.174267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.174267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.174267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.184817] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 896.455630] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-fdd007d0-127d-413a-8e8c-889e76257189 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 896.455812] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-fdd007d0-127d-413a-8e8c-889e76257189 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 896.455948] env[66131]: INFO networking_nsxv3.common.synchronization [req-a650df21-6581-42fb-8127-217eccb88c80 req-fdd007d0-127d-413a-8e8c-889e76257189 service nova] Enqueued Resource ID: d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 with Priority: HIGHEST for action port [ 896.456474] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 896.456611] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 896.456709] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 with Priority: HIGHEST for action port [ 896.456978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.457289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.457556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.457601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.457776] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.457911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.457948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.458124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.458202] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e4d1f6-d89a-4b3d-a976-050eeaa3e316',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.555051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 in Status: SUCCESS [ 896.559558] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 deletion is rescheduled due to dependency. [ 896.559558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.770309] env[66131]: INFO networking_nsxv3.common.synchronization [req-d368aa78-87c2-4715-ad4c-ab5b05266eca req-03c9fc35-256c-4775-8259-649f77b40c09 tempest-ServerRescueTestJSONUnderV235-805145790 tempest-ServerRescueTestJSONUnderV235-805145790-project-member] Enqueued Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 896.770949] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 with Priority: HIGHEST for action security_group_members [ 896.771415] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.771543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.859713] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 896.859713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.859713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.859713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.860074] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.860074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.860074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.860189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.860226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.860399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.860464] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.861264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.861816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.864895] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.864895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.864895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.864895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.864895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.864895] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.962112] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 with status ACTIVE [ 896.962446] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.962607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.962681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.963398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.963506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.963702] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.963825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.963900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.964125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.964260] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.964484] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.964600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.964648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.964783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.964860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.964935] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7e4d1f6-d89a-4b3d-a976-050eeaa3e316 is going to be updated. [ 896.987378] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.987545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.987622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.988227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.988227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.988227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7e4d1f6-d89a-4b3d-a976-050eeaa3e316" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.365506] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.365506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.365506] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.420649] env[66131]: INFO networking_nsxv3.common.synchronization [None req-97ffce60-190f-4e8c-9495-1d51afde33ee tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_rules [ 897.421552] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_rules [ 897.422293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.422293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.422293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.422293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.422503] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.517112] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6432b1d3-11fe-4b11-8176-b1364cc733ac tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_rules [ 897.517746] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_rules [ 897.518086] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.518186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.868319] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.945721] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.945721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.949075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.949075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.949075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.949075] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 already deleted. [ 897.949278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.949751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.949845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.950105] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.205371] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 898.205629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.205805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.206040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.206233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.206351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.206419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.206575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.206682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.206768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.207058] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee60aad-d226-4523-a7e1-25a5307d17e8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.207058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.207191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.207248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.207381] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.207515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.207550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.207678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.207756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.207836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.207911] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.208833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.208988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.209759] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.209759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.209759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.209759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.209759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.209759] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.372283] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.372855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.372855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.372977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.373271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.373490] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 898.410595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.410815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.410864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.411197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.411465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.423811] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 898.474196] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.474445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.474445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.474646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.474743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.474829] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 already deleted. [ 898.474909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.713471] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ee60aad-d226-4523-a7e1-25a5307d17e8: rpc.has_security_group_logging(os_id): False [ 898.714710] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.714843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.714907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.715158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.734659] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.734843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.746843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.747502] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.747640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.747707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.747919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.748012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.748108] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be updated. [ 898.749188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.749366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.749453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.749683] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.749791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.749854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.749991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.750076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.750249] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.750343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.750404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.750536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.750606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.750778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.750886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.751017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.751170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.751258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.751653] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be updated. [ 898.780843] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.780989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.781076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.781413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.781573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.793642] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 898.833370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.833596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.833701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.834081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.835042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.856032] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: IN_PROGRESS for 2s [ 900.434294] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 900.434631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.435555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.435555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.435555] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.435555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.435555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.435555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.435555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.435817] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.808452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 900.808671] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 deletion is rescheduled due to dependency. [ 900.810022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.869085] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 in Status: SUCCESS [ 900.869390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.869695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.871120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.871120] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee60aad-d226-4523-a7e1-25a5307d17e8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.939020] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.392728] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.392874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.392948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.393182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.393276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.393459] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee60aad-d226-4523-a7e1-25a5307d17e8 is going to be deleted. [ 901.440179] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.455482] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.455686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.455740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.455955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.456067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.456203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee60aad-d226-4523-a7e1-25a5307d17e8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.943944] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.944163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.944163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.944507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.944626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.944776] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 901.984027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.984027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.984027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.984027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.984027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.994297] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 902.519077] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 902.519371] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 903.067483] env[66131]: INFO networking_nsxv3.common.synchronization [req-c9e8cd11-3587-4375-b8b4-3c8d0c965fd5 req-20efbcb9-f24f-4ae9-b028-a57ea2f4a491 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 903.068055] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 903.068379] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.068519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.068592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.068776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.069332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.071149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.071149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.071149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.071149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.071149] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.576508] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.011118] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 904.011295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.011412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.011612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.011833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.011973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.012807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.012807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.012807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.012807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.012807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.012807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.012807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.013400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.013400] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.013400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.013400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.014188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.014188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.014188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.014188] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.079623] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.516270] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcda49b5-8fd1-462d-976a-a25d59236231: rpc.has_security_group_logging(os_id): False [ 904.539318] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.539479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.539542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.539779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.539872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.540140] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.540211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.540249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.540383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.540464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.540645] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.540746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.540803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.540923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.540992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.541192] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.541306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.541411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.541526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.541597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.541684] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be created. [ 904.583808] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.584194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.584194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.584356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.584356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.584486] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 904.606262] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.606610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.606682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.607030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.607212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.627796] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 904.630358] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.630358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.630358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.630358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.630358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.642964] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 905.725189] env[66131]: INFO networking_nsxv3.common.synchronization [None req-4d15d619-caf2-4d30-9907-5eb19d692cec None None] Enqueued Resource ID: f3033769-7c2e-467c-bdf5-47b0f1690b2e with Priority: HIGHEST for action port [ 905.725189] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3033769-7c2e-467c-bdf5-47b0f1690b2e with Priority: HIGHEST for action port [ 905.725189] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3033769-7c2e-467c-bdf5-47b0f1690b2e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.725810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3033769-7c2e-467c-bdf5-47b0f1690b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.726048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3033769-7c2e-467c-bdf5-47b0f1690b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.726400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3033769-7c2e-467c-bdf5-47b0f1690b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.726583] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3033769-7c2e-467c-bdf5-47b0f1690b2e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.829859] env[66131]: INFO networking_nsxv3.common.synchronization [req-b21e7908-53c4-426c-bb16-1e0ca6b38781 req-3896343d-de1d-4c90-841d-b929a5450aad tempest-ServersV294TestFqdnHostnames-31794505 tempest-ServersV294TestFqdnHostnames-31794505-project-member] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_members [ 905.829859] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_members [ 905.830306] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.830306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.830306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.830564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.830703] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.830833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.830872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.831697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.831801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.831943] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.229639] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3033769-7c2e-467c-bdf5-47b0f1690b2e [ 906.230100] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.230342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.230471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.230787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.230920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.231077] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3033769-7c2e-467c-bdf5-47b0f1690b2e already deleted. [ 906.231354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3033769-7c2e-467c-bdf5-47b0f1690b2e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.335067] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.335348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.335348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.335571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.335690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.335850] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.335947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.336060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.336247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.336327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.336415] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 already deleted. [ 906.336499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.351988] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-515 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.352235] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-515" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.352334] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-515" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.352740] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-515" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.353093] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.353465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.353695] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.354077] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.354313] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.354642] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.354781] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.354893] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.355017] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.355126] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.355230] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.355360] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.378892] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.379145] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.379354] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.379551] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-515" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.379883] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.380176] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.380270] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.380529] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.380663] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7bd17b-71b3-4c4c-aae4-2123e669f1b7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.404891] env[66131]: INFO networking_nsxv3.common.synchronization [req-5c7c8008-75c9-474c-b3fe-f0690844a801 req-22b74298-157b-4aef-8d12-86e0b444ea4d tempest-ServersTestJSON-564409179 tempest-ServersTestJSON-564409179-project-member] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_members [ 906.405619] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGHEST for action security_group_members [ 906.405964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.406102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.406164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.406381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.406533] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.407353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.407353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.407353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.407353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.407353] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.644120] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 906.644428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.645801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.646079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.646198] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.656034] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 906.656034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.883628] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.883945] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.883945] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.884342] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.884590] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.887191] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 not found, creating... [ 906.887191] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.887191] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.887191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.887603] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.887603] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 is going to be created. [ 906.910256] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.910452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.910575] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.910844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.911148] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.911640] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.913542] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.913542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.913542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.913542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.944336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.944602] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.944743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.944812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.945082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.945150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.945246] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 is going to be updated. [ 907.023285] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.023487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.023558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.023776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.024195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.036599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 in Status: IN_PROGRESS for 2s [ 907.148900] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.149170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.149249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.149544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.149721] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.149823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.149919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.150728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.150728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.150728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.150728] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.653235] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.653235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.653326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.653652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.653716] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.654428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.654428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.654428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.654607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.654739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.655074] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.655932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.655932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.655932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.655932] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.655932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.655932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.655932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.656224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.656224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.656224] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.659861] env[66131]: INFO networking_nsxv3.common.synchronization [req-d41f1a67-5d97-491d-b87f-8d32db0aa620 req-3e1b627f-edba-49a7-bf81-ba7e1a3259df tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 907.660593] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 907.660677] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.660753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.660822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.660990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.661153] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.661335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.661335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.661440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.661515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.661601] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.681057] env[66131]: INFO networking_nsxv3.common.synchronization [req-b21e7908-53c4-426c-bb16-1e0ca6b38781 req-7dee010a-7c74-409e-b9a1-367462446ad6 service nova] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_rules [ 907.681393] env[66131]: INFO networking_nsxv3.common.synchronization [req-b21e7908-53c4-426c-bb16-1e0ca6b38781 req-7dee010a-7c74-409e-b9a1-367462446ad6 service nova] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_members [ 907.681583] env[66131]: INFO networking_nsxv3.common.synchronization [req-b21e7908-53c4-426c-bb16-1e0ca6b38781 req-7dee010a-7c74-409e-b9a1-367462446ad6 service nova] Enqueued Resource ID: 9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 with Priority: HIGHEST for action port [ 907.682512] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_rules [ 907.682706] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_members [ 907.682832] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 with Priority: HIGHEST for action port [ 907.683259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.683634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.683634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.683855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.684035] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.684932] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.685060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.685130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.685302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.685812] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.685812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.685812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.685812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.685812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.686133] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.686957] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.687077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.687164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.687322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.687400] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7bd17b-71b3-4c4c-aae4-2123e669f1b7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.998140] env[66131]: INFO networking_nsxv3.common.synchronization [req-d27408ce-cfa4-4eba-bb7d-7e48aca9e381 req-52d34f04-86c4-493e-9688-4cacdcbff1c3 tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 908.000755] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 908.001560] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.001818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.158848] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcda49b5-8fd1-462d-976a-a25d59236231: rpc.has_security_group_logging(os_id): False [ 908.163161] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.179527] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.179650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.179901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.180043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.180111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.180869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.180869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.180869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.180869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.180869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.181090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.181090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.181090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.181211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.181317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.181653] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.181797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.181883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.182052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.182143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.182235] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 908.188918] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.192026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.192414] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 with status ACTIVE [ 908.192591] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.192591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.192678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.193062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.193062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.193467] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.193530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.193614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.194083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.194083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.194083] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.194083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.194275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.194275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.194356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.194503] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e7bd17b-71b3-4c4c-aae4-2123e669f1b7 is going to be updated. [ 908.195612] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.217557] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.217728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.217800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.218027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.218173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.218430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e7bd17b-71b3-4c4c-aae4-2123e669f1b7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.255989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.255989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.255989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.256210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.256247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.268024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 908.551466] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ec03c634-71d1-4b70-bc7b-acf3809baa79 None None] Enqueued Resource ID: 7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c with Priority: HIGHEST for action port [ 908.552108] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c with Priority: HIGHEST for action port [ 908.552819] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.552819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.552819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.553174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.553254] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.665757] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.699503] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.050957] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 in Status: SUCCESS [ 909.051210] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 deletion is rescheduled due to dependency. [ 909.051210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.056732] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c [ 909.056732] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.056732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.056732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.056732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.056732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.056732] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c already deleted. [ 909.056732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f5f37cc-f84b-4dc5-bfa0-64ae5a9a462c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.169455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.169696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.169845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.170153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.170318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.170475] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 909.197782] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.197925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.197998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.198234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.198454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.200948] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.201090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.201159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.201359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.201424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.201519] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 is going to be created. [ 909.212538] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 909.224202] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.224456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.224456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.224635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.224983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.233626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: UNINITIALIZED for 2s [ 910.167831] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2822ae37-b417-41d0-9eb2-9995f14b6a96 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 107dacd9-394d-43d4-b825-0e287939c2aa with Priority: HIGHEST for action security_group_rules [ 910.167831] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107dacd9-394d-43d4-b825-0e287939c2aa with Priority: HIGHEST for action security_group_rules [ 910.168162] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-107dacd9-394d-43d4-b825-0e287939c2aa taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.168279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.168345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.168626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.168697] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('107dacd9-394d-43d4-b825-0e287939c2aa',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.288769] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 910.288769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.338853] env[66131]: INFO networking_nsxv3.common.synchronization [None req-d8094047-a4f6-4369-bcae-a0ae844720d9 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 107dacd9-394d-43d4-b825-0e287939c2aa with Priority: HIGHEST for action security_group_rules [ 910.339300] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107dacd9-394d-43d4-b825-0e287939c2aa with Priority: HIGHEST for action security_group_rules [ 910.339942] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-107dacd9-394d-43d4-b825-0e287939c2aa taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.339942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.688594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.688781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.688836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.689036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.689133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.689226] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 107dacd9-394d-43d4-b825-0e287939c2aa already deleted. [ 910.689311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.689463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.689620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.689704] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('107dacd9-394d-43d4-b825-0e287939c2aa',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.213942] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.214318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.214318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.214398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.214457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.214553] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 107dacd9-394d-43d4-b825-0e287939c2aa already deleted. [ 911.214648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-107dacd9-394d-43d4-b825-0e287939c2aa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.223758] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 4s [ 911.246661] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: UNINITIALIZED for 4s [ 911.504500] env[66131]: INFO networking_nsxv3.common.synchronization [req-00a8dead-1878-432b-8fa2-1d53b2d823ec req-7da151da-621c-4730-9581-3e34b41bb82d tempest-MigrationsAdminTest-1398354370 tempest-MigrationsAdminTest-1398354370-project-member] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 911.505071] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 911.505621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.505621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.505621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.505784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.506140] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.506140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.506140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.506295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.506330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.506412] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.008696] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.514546] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.020869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.020869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.020869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.020869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.020869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.020869] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be updated. [ 913.053298] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.055032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.055032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.055032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.055032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.071466] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 913.238784] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 913.239513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.239777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.240931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.240931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.240931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.240931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.240931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.240931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.241400] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.257273] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: SUCCESS [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.257273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.257273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.257273] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.743891] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.744227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.744227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.745053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.745053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.745053] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.745053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.745053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.745053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.745053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.745346] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 913.762496] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.774428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.774428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.774428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.774428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.774428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.784772] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 914.267051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207: rpc.has_security_group_logging(os_id): False [ 914.300597] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.300736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.300832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.301044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.301135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.301499] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.301908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.301908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.301908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.301908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.302161] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 is going to be created. [ 914.305749] env[66131]: INFO networking_nsxv3.common.synchronization [req-89ddddec-06de-4d92-9fce-2ec6d22cc48c req-5fb24dd8-d85e-455b-a28c-bc0d0db2eac7 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 914.306450] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 914.306901] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.306901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.307051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.307181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.307352] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.307471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.311215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.311679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.311850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.311971] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.375457] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.375739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.375822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.376092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.376330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.391170] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: IN_PROGRESS for 2s [ 914.817336] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.817565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.817565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.817955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.838728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.839057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.841020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.841020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.841020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.841020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.841020] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 914.873324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.873468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.873589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.873814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.873997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.885970] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 915.083847] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 915.084097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.795701] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 915.795953] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 deletion is rescheduled due to dependency. [ 915.796118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.410808] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: SUCCESS [ 916.410808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.895650] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 916.895783] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 916.896997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.123150] env[66131]: INFO networking_nsxv3.common.synchronization [None req-49e427ea-2efb-47f5-bc30-611b5469b818 None None] Enqueued Resource ID: 39dbcf7e-394d-4b61-9c93-1deae3e8acca with Priority: HIGHEST for action port [ 917.123414] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39dbcf7e-394d-4b61-9c93-1deae3e8acca with Priority: HIGHEST for action port [ 917.124038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-39dbcf7e-394d-4b61-9c93-1deae3e8acca taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.124166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39dbcf7e-394d-4b61-9c93-1deae3e8acca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.124228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39dbcf7e-394d-4b61-9c93-1deae3e8acca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.124486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39dbcf7e-394d-4b61-9c93-1deae3e8acca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.124573] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39dbcf7e-394d-4b61-9c93-1deae3e8acca',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.627550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39dbcf7e-394d-4b61-9c93-1deae3e8acca [ 917.629225] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.629225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.629225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.629225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.629225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.629225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39dbcf7e-394d-4b61-9c93-1deae3e8acca already deleted. [ 917.629225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39dbcf7e-394d-4b61-9c93-1deae3e8acca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.140520] env[66131]: INFO networking_nsxv3.common.synchronization [req-77a219e9-2540-4c15-a7a3-c5d7932a65e6 req-a7ade59e-7fcf-4379-b026-b94af69a712a tempest-ServersAdminTestJSON-442091106 tempest-ServersAdminTestJSON-442091106-project-member] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 918.143029] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGHEST for action security_group_members [ 918.143029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.143029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.143029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.143029] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.472994] env[66131]: INFO networking_nsxv3.common.synchronization [None req-bbf61642-99c2-4299-86d7-76a00a537485 None None] Enqueued Resource ID: 33d5a975-24c0-4956-bc7d-9da7efd4d388 with Priority: HIGHEST for action port [ 918.474425] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d5a975-24c0-4956-bc7d-9da7efd4d388 with Priority: HIGHEST for action port [ 918.474798] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-33d5a975-24c0-4956-bc7d-9da7efd4d388 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.474890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33d5a975-24c0-4956-bc7d-9da7efd4d388" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.474954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33d5a975-24c0-4956-bc7d-9da7efd4d388" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.475243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33d5a975-24c0-4956-bc7d-9da7efd4d388" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.475344] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33d5a975-24c0-4956-bc7d-9da7efd4d388',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.645623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.645623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.645623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.646108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674504] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.674504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.674504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674504] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be updated. [ 918.707254] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.707726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.707726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.707726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.707895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.717563] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: IN_PROGRESS for 2s [ 918.982068] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33d5a975-24c0-4956-bc7d-9da7efd4d388 [ 918.982068] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.982068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.982068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.982068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.982068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.982068] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33d5a975-24c0-4956-bc7d-9da7efd4d388 already deleted. [ 918.982068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33d5a975-24c0-4956-bc7d-9da7efd4d388" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.522558] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5f3ecece-86c3-401b-b865-68cedd6b4d81 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 919.523098] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 919.523693] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.524511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.524511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.524511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.524511] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.725435] env[66131]: INFO networking_nsxv3.common.synchronization [None req-d7746922-6ad0-42bc-b142-e4c3ef0129e5 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 919.726032] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 919.726354] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.726459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.048654] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.048916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.048959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.049262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.049311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.049401] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 already deleted. [ 920.049476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.049823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.050014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.050104] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.129024] env[66131]: INFO networking_nsxv3.common.synchronization [None req-986586b2-e297-4703-8f19-084763e53eb5 None None] Enqueued Resource ID: 889044a9-9aa9-4902-b8a5-04b0c835c16f with Priority: HIGHEST for action port [ 920.129024] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 889044a9-9aa9-4902-b8a5-04b0c835c16f with Priority: HIGHEST for action port [ 920.129024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-889044a9-9aa9-4902-b8a5-04b0c835c16f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.129024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-889044a9-9aa9-4902-b8a5-04b0c835c16f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.129024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-889044a9-9aa9-4902-b8a5-04b0c835c16f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.129024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-889044a9-9aa9-4902-b8a5-04b0c835c16f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.129024] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('889044a9-9aa9-4902-b8a5-04b0c835c16f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.572306] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.572306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.572306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.572306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.572306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.572306] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 already deleted. [ 920.572306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.637646] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 889044a9-9aa9-4902-b8a5-04b0c835c16f [ 920.637646] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.637646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.637646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.637646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.637646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.637646] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:889044a9-9aa9-4902-b8a5-04b0c835c16f already deleted. [ 920.637646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-889044a9-9aa9-4902-b8a5-04b0c835c16f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.727793] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 in Status: SUCCESS [ 920.728115] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 deletion is rescheduled due to dependency. [ 920.728115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.929750] env[66131]: INFO networking_nsxv3.common.synchronization [None req-555ac754-4142-42b5-bb66-7164b6b186d4 None None] Enqueued Resource ID: 925878d8-acd9-4093-8f75-eaff2567ad00 with Priority: HIGHEST for action port [ 920.930720] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925878d8-acd9-4093-8f75-eaff2567ad00 with Priority: HIGHEST for action port [ 920.930720] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-925878d8-acd9-4093-8f75-eaff2567ad00 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.930720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-925878d8-acd9-4093-8f75-eaff2567ad00" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.930954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-925878d8-acd9-4093-8f75-eaff2567ad00" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.931107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-925878d8-acd9-4093-8f75-eaff2567ad00" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.931190] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('925878d8-acd9-4093-8f75-eaff2567ad00',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.433951] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 925878d8-acd9-4093-8f75-eaff2567ad00 [ 921.439106] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.439106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.439106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.439106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.439106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.439106] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:925878d8-acd9-4093-8f75-eaff2567ad00 already deleted. [ 921.439106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-925878d8-acd9-4093-8f75-eaff2567ad00" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.338692] env[66131]: INFO networking_nsxv3.common.synchronization [req-dab02c8e-a379-4870-8f61-35f599ccfea1 req-2da44b5c-fb55-48d4-b29a-11cecaee329e tempest-ServerRescueTestJSON-1428891184 tempest-ServerRescueTestJSON-1428891184-project-member] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 924.339697] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 924.339697] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.339697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.339920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.340076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.340823] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.340823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.340823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.340823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.340823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.340823] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.788765] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.788765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.788765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.788765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.789093] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.789217] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.789273] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.789475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.789616] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.790193] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.790377] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.790733] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.790853] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.790968] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.791103] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.791236] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.815264] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.815401] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.815672] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.815734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-364" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.816318] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-00cec0f9-672e-4c08-a482-c7a1691ba21f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.816318] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.816429] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.816666] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.816980] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00cec0f9-672e-4c08-a482-c7a1691ba21f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.843298] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.319898] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.320160] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.320308] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.320610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.320761] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.320917] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 00cec0f9-672e-4c08-a482-c7a1691ba21f not found, creating... [ 925.321272] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.321439] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.321557] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.321804] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.321946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.322281] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.322496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.322623] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.322832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.322989] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.323164] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 00cec0f9-672e-4c08-a482-c7a1691ba21f is going to be created. [ 925.345447] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.345891] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.345891] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.346088] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.346325] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.346553] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.347401] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.850113] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.850287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.850366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.850573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.850660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.850760] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be updated. [ 925.947618] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.947618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.947618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.947618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.947618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.961620] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: IN_PROGRESS for 2s [ 926.539607] env[66131]: INFO networking_nsxv3.common.synchronization [req-dab02c8e-a379-4870-8f61-35f599ccfea1 req-7a5e5797-4e56-435f-a403-7e2cb66b2b33 service nova] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_rules [ 926.539812] env[66131]: INFO networking_nsxv3.common.synchronization [req-dab02c8e-a379-4870-8f61-35f599ccfea1 req-7a5e5797-4e56-435f-a403-7e2cb66b2b33 service nova] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 926.539928] env[66131]: INFO networking_nsxv3.common.synchronization [req-dab02c8e-a379-4870-8f61-35f599ccfea1 req-7a5e5797-4e56-435f-a403-7e2cb66b2b33 service nova] Enqueued Resource ID: 00cec0f9-672e-4c08-a482-c7a1691ba21f with Priority: HIGHEST for action port [ 926.540524] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_rules [ 926.540680] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 926.541597] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cec0f9-672e-4c08-a482-c7a1691ba21f with Priority: HIGHEST for action port [ 926.542133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.542262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.542331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.542593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.542677] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.543636] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.543758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.543987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-00cec0f9-672e-4c08-a482-c7a1691ba21f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.544416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.544523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.544744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.544825] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00cec0f9-672e-4c08-a482-c7a1691ba21f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.049328] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.049328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.049328] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00cec0f9-672e-4c08-a482-c7a1691ba21f with status ACTIVE [ 927.049328] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.049328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.049666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.049666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.049735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.049946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.050096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.050170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.050351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.050449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.050676] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.050861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.050932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.051073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.051171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.051270] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00cec0f9-672e-4c08-a482-c7a1691ba21f is going to be updated. [ 927.075287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.075287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.075287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.075287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.075287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.075287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00cec0f9-672e-4c08-a482-c7a1691ba21f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.977720] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 927.977720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.979185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.979185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.979185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.979665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.980800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.980800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.980800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.980800] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.467648] env[66131]: INFO networking_nsxv3.common.synchronization [None req-00826426-565b-4e66-b5b6-2030ffb3e44b None None] Enqueued Resource ID: ba6f5e38-4579-420b-8be2-9c1da8d4daf0 with Priority: HIGHEST for action port [ 928.470109] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f5e38-4579-420b-8be2-9c1da8d4daf0 with Priority: HIGHEST for action port [ 928.470109] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba6f5e38-4579-420b-8be2-9c1da8d4daf0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.470109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba6f5e38-4579-420b-8be2-9c1da8d4daf0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.470109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba6f5e38-4579-420b-8be2-9c1da8d4daf0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.470628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba6f5e38-4579-420b-8be2-9c1da8d4daf0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.470628] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6f5e38-4579-420b-8be2-9c1da8d4daf0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.483158] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.862868] env[66131]: INFO networking_nsxv3.common.synchronization [req-40134ab4-967d-43cb-b30e-d3c0952e440b req-69000242-2d66-4c4c-942d-6a0d3823b55a tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_members [ 928.863560] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_members [ 928.863978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.864305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.865118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.865413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.865612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.866039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.866039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.866185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.866278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.866375] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.973157] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba6f5e38-4579-420b-8be2-9c1da8d4daf0 [ 928.973860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.974471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.974471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.974471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.974471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.974759] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba6f5e38-4579-420b-8be2-9c1da8d4daf0 already deleted. [ 928.974759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba6f5e38-4579-420b-8be2-9c1da8d4daf0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.987636] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.291117] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.291117] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.291117] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.291117] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.292580] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.293512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.293512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.293941] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.295729] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.296126] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.296374] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.296643] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.299024] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.299024] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.299024] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.299024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.319039] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.319039] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 929.319039] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.319039] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.319844] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.320278] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.320659] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.322201] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.322201] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e6dabb-ed3b-42e6-a7c5-ab607fdf7256',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.368734] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.370607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.370696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.370899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.371821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.371821] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.371821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.371821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.371821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.371821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.371821] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 already deleted. [ 929.371821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.494059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.494059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.494059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.494059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.494059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.494059] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be updated. [ 929.528690] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.528690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.528690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.528690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.528690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.537940] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: IN_PROGRESS for 2s [ 929.825819] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.825819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.825819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.825819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.825819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.826062] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 not found, creating... [ 929.826148] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.826308] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.826427] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.826652] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.826792] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.827087] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.827242] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.827357] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.827566] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.827701] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.827841] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 is going to be created. [ 929.850195] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.850391] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.850512] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.850956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.851047] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.851281] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.595389] env[66131]: INFO networking_nsxv3.common.synchronization [req-40134ab4-967d-43cb-b30e-d3c0952e440b req-b8d72bf9-f046-45e3-a8fd-d9152f178aa0 service nova] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_rules [ 930.595671] env[66131]: INFO networking_nsxv3.common.synchronization [req-40134ab4-967d-43cb-b30e-d3c0952e440b req-b8d72bf9-f046-45e3-a8fd-d9152f178aa0 service nova] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_members [ 930.596158] env[66131]: INFO networking_nsxv3.common.synchronization [req-40134ab4-967d-43cb-b30e-d3c0952e440b req-b8d72bf9-f046-45e3-a8fd-d9152f178aa0 service nova] Enqueued Resource ID: 89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 with Priority: HIGHEST for action port [ 930.596946] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_rules [ 930.596946] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_members [ 930.597392] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 with Priority: HIGHEST for action port [ 930.597523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.597688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.597804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.598352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.598437] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.599486] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.600430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.600430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.600430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.600430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.600931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.600931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.601126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.601385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.601385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.603115] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.603228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.603662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.603662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.603662] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e6dabb-ed3b-42e6-a7c5-ab607fdf7256',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.105925] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.106448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.106722] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.108524] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 with status ACTIVE [ 931.109327] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.109559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.110878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.110878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.112637] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.112637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.112637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.112637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.112637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.112637] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.112637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.112637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.113034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.113034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.113148] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89e6dabb-ed3b-42e6-a7c5-ab607fdf7256 is going to be updated. [ 931.141323] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.141323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.141323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.141323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.141323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.141323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e6dabb-ed3b-42e6-a7c5-ab607fdf7256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.550776] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 931.551031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.551622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.551622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.551801] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.551920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.551968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.552179] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.552268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.552365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.552465] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.617171] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.055974] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.056189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.056274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.056454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.056662] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.056723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.056778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.056924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.057026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.057115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.057341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.057507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.057551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.057687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.057831] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.057924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.057985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.058153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.058233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.058316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.058406] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.119408] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.119771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.119771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.119883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.120078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.120078] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 is going to be created. [ 932.146786] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.147104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.147227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.147397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.147610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.160152] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 in Status: UNINITIALIZED for 2s [ 932.562113] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d77f610-439c-48b3-8ae3-c867ae6ba8f2: rpc.has_security_group_logging(os_id): False [ 932.581728] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.582016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.582084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.582335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.620121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.620121] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.620121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.620635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.620635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.620635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.620719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.620787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.620904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.621034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.621078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.621287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.621384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.621455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.621625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.621702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.621790] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be updated. [ 932.699879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.700215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.700287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.700578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.700827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.717305] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: IN_PROGRESS for 2s [ 934.171368] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 in Status: SUCCESS [ 934.171702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.171959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.172390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.172804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.173024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.173130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.173370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.173512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.173696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.173839] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.677215] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.732301] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 934.732565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.178891] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62: rpc.has_security_group_logging(os_id): False [ 935.196860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.197027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.197100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.197313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.197407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.197643] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.197746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.197810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.197958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.198045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.198131] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 is going to be created. [ 935.256363] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.256363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.256589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.256686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.256822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.269824] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 in Status: IN_PROGRESS for 2s [ 935.598114] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 935.598413] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 937.286321] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 in Status: SUCCESS [ 937.286749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.347713] env[66131]: INFO networking_nsxv3.common.synchronization [req-23ec4096-ed14-4aa0-8847-5b9eb98d46c9 req-37cd54f6-00b9-4d51-a4ee-30f3fc038208 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 937.348511] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 937.348931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.350476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.350550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.350836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.351087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.351253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.351357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.351793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.351940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.352016] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.854390] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.854731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.854731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.854960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.878993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.878993] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.879181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.879181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.879530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.879680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.879872] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 937.928305] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.928488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.928554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.928777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.928931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.939589] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 938.763520] env[66131]: INFO networking_nsxv3.common.synchronization [req-1cfedad0-be70-451e-9868-78f37d871f85 req-df61a790-647c-43dc-a613-2c4273c714ab tempest-ServersTestFqdnHostnames-1386842827 tempest-ServersTestFqdnHostnames-1386842827-project-member] Enqueued Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_members [ 938.764363] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef72789-9405-4544-841f-1905c2771a0d with Priority: HIGHEST for action security_group_members [ 938.764930] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-eef72789-9405-4544-841f-1905c2771a0d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.764930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.764930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.765184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.765256] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.765351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.765402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.765553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.765628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.765732] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eef72789-9405-4544-841f-1905c2771a0d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.270343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.270896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.270896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.270896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.271109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.271240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.272842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.272842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.272842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.272842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.272842] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef72789-9405-4544-841f-1905c2771a0d is going to be updated. [ 939.308898] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.309102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.309206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.309483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.309643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.324341] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef72789-9405-4544-841f-1905c2771a0d in Status: IN_PROGRESS for 2s [ 939.951019] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 939.951019] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 939.951019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.335971] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eef72789-9405-4544-841f-1905c2771a0d in Status: SUCCESS [ 941.336344] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eef72789-9405-4544-841f-1905c2771a0d deletion is rescheduled due to dependency. [ 941.336344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eef72789-9405-4544-841f-1905c2771a0d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.975857] env[66131]: INFO networking_nsxv3.common.synchronization [req-b6667bb4-4ec2-472d-9072-611acb872dc2 req-92919da6-db13-40c0-9379-c1d1870fdc5e tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 942.976361] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 942.976671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.976952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.976952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.977410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.977687] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.977746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.977789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.977924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.978026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.978287] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.361379] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.361592] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.361762] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.362085] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.362373] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.362546] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.362702] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.362884] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.363042] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.363249] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.363363] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.363482] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.363597] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.363716] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.363839] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.363975] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.384134] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.384338] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.384451] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.384609] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.384962] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-a385ad48-7664-4172-858b-7f63d686c90c taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.385155] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.385291] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.385602] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.385733] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a385ad48-7664-4172-858b-7f63d686c90c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.480735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.481015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.481105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.481341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.481446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.481719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.481851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.481929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.482151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.482261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.482357] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 already deleted. [ 943.482445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.890216] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.890781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.890882] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.891120] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.891275] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.891425] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port a385ad48-7664-4172-858b-7f63d686c90c not found, creating... [ 943.891704] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.891861] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.891977] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.892220] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.892364] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.892658] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.892795] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.893252] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.893375] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.893511] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.893649] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: a385ad48-7664-4172-858b-7f63d686c90c is going to be created. [ 943.916540] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.916747] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.916866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.917160] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.917450] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.917607] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.042628] env[66131]: INFO networking_nsxv3.common.synchronization [None req-ad5cbc27-8aa7-486e-ada9-af7cd52f0a65 None None] Enqueued Resource ID: 2746e9e3-0e33-4bb7-8252-102d49f5df24 with Priority: HIGHEST for action port [ 944.043394] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2746e9e3-0e33-4bb7-8252-102d49f5df24 with Priority: HIGHEST for action port [ 944.043870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2746e9e3-0e33-4bb7-8252-102d49f5df24 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.044040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2746e9e3-0e33-4bb7-8252-102d49f5df24" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.044134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2746e9e3-0e33-4bb7-8252-102d49f5df24" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.044464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2746e9e3-0e33-4bb7-8252-102d49f5df24" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.044855] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2746e9e3-0e33-4bb7-8252-102d49f5df24',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.551787] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2746e9e3-0e33-4bb7-8252-102d49f5df24 [ 944.551787] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.551787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.551787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.551787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.551787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.551787] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2746e9e3-0e33-4bb7-8252-102d49f5df24 already deleted. [ 944.551787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2746e9e3-0e33-4bb7-8252-102d49f5df24" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.709282] env[66131]: INFO networking_nsxv3.common.synchronization [req-b6667bb4-4ec2-472d-9072-611acb872dc2 req-f3e98c85-4c93-4b31-96a7-aaa3b0fa9010 service nova] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_rules [ 944.709282] env[66131]: INFO networking_nsxv3.common.synchronization [req-b6667bb4-4ec2-472d-9072-611acb872dc2 req-f3e98c85-4c93-4b31-96a7-aaa3b0fa9010 service nova] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 944.709282] env[66131]: INFO networking_nsxv3.common.synchronization [req-b6667bb4-4ec2-472d-9072-611acb872dc2 req-f3e98c85-4c93-4b31-96a7-aaa3b0fa9010 service nova] Enqueued Resource ID: a385ad48-7664-4172-858b-7f63d686c90c with Priority: HIGHEST for action port [ 944.709282] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_rules [ 944.709282] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 944.709282] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a385ad48-7664-4172-858b-7f63d686c90c with Priority: HIGHEST for action port [ 944.709282] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.709282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.709282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.709282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.709282] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.710826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.711105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.711313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.711609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.712643] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.712643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.712643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.712643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.712643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.712643] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.716913] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a385ad48-7664-4172-858b-7f63d686c90c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.716913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.716913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.716913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.716913] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a385ad48-7664-4172-858b-7f63d686c90c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.146500] env[66131]: INFO networking_nsxv3.common.synchronization [None req-aecc2ba9-3b7d-4740-82eb-19ed2778af77 tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 945.147027] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 945.147338] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.147458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.147753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.147813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.147859] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.215952] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.216984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.217118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.217680] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a385ad48-7664-4172-858b-7f63d686c90c with status ACTIVE [ 945.217680] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.218035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.218035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.218035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.218140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.218271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.218367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.218430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.218589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.218664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.219734] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.219734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.219734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.219734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.219734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.219734] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a385ad48-7664-4172-858b-7f63d686c90c is going to be updated. [ 945.226046] env[66131]: INFO networking_nsxv3.common.synchronization [None req-d7ca755b-e2cf-463c-9a29-420d87d514b8 tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 945.226425] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 945.226650] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.226866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.243049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.243228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.243303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.243510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.243669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.243901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a385ad48-7664-4172-858b-7f63d686c90c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.298094] env[66131]: INFO networking_nsxv3.common.synchronization [req-3f1db83d-8c4d-48e3-a5b7-d11d059a06a6 req-a052e30b-1301-4c70-ba11-8fc9b18fd38b tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 945.298826] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 945.298925] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.299042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.667915] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.668149] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.668254] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.668509] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.668770] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.668921] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.669055] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.669260] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.669402] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.669603] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.669713] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.669878] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.670480] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.670480] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.670480] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.670480] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.675264] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.675264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.675264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.675264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.675264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.675264] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 already deleted. [ 945.675264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.676114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.676291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.676378] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.696204] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.696392] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.696532] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.696712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.697042] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.697250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.697343] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.697668] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.697823] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.718810] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.202657] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.202991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.203202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.203523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.203663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.203827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 already deleted. [ 946.203961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.205363] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.205683] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.205820] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.206171] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.206358] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.206697] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff not found, creating... [ 946.206933] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.207306] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.207440] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.207655] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.207800] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.208102] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.208261] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.208377] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.208584] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.208716] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.208850] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff is going to be created. [ 946.222113] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.222288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.222335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.222554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.222642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.222739] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be created. [ 946.243862] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.243862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.243862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.243862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.244151] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.244291] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.253169] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.253169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.253169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.253169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.253169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.267620] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: UNINITIALIZED for 2s [ 946.406219] env[66131]: INFO networking_nsxv3.common.synchronization [None req-55e1ec52-2f7c-46a6-8a22-71af8ba9bfda None None] Enqueued Resource ID: b959cda0-8ec6-45a9-b76e-febcf665842f with Priority: HIGHEST for action port [ 946.407188] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b959cda0-8ec6-45a9-b76e-febcf665842f with Priority: HIGHEST for action port [ 946.407565] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b959cda0-8ec6-45a9-b76e-febcf665842f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.407689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b959cda0-8ec6-45a9-b76e-febcf665842f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.407754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b959cda0-8ec6-45a9-b76e-febcf665842f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.408036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b959cda0-8ec6-45a9-b76e-febcf665842f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.408135] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b959cda0-8ec6-45a9-b76e-febcf665842f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.910805] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b959cda0-8ec6-45a9-b76e-febcf665842f [ 946.911057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.911192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.911259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.911478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.911570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.911665] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b959cda0-8ec6-45a9-b76e-febcf665842f already deleted. [ 946.911749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b959cda0-8ec6-45a9-b76e-febcf665842f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.006159] env[66131]: INFO networking_nsxv3.common.synchronization [req-3f1db83d-8c4d-48e3-a5b7-d11d059a06a6 req-1a78bb74-68bf-4ec6-b6e9-e158f45cbdcd service nova] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_rules [ 947.006383] env[66131]: INFO networking_nsxv3.common.synchronization [req-3f1db83d-8c4d-48e3-a5b7-d11d059a06a6 req-1a78bb74-68bf-4ec6-b6e9-e158f45cbdcd service nova] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 947.006521] env[66131]: INFO networking_nsxv3.common.synchronization [req-3f1db83d-8c4d-48e3-a5b7-d11d059a06a6 req-1a78bb74-68bf-4ec6-b6e9-e158f45cbdcd service nova] Enqueued Resource ID: 6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff with Priority: HIGHEST for action port [ 947.009158] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_rules [ 947.009388] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 947.009388] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff with Priority: HIGHEST for action port [ 947.009688] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.009791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.009985] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.010084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.010283] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.010383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.010448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.010647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.010727] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.513990] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff with status ACTIVE [ 947.514968] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.514968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.514968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.515185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.515293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.515411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.515526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.515580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.515744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.515817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.516033] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.516124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.516164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.516328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.516377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.516448] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff is going to be updated. [ 947.541038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.541241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.541877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.541877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.541877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.541877] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bdd06a3-e14c-4bef-b92d-48d33f9ce1ff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.801498] env[66131]: INFO networking_nsxv3.common.synchronization [req-ec2988ad-277d-474f-b8c5-889c4036f6d7 req-53061386-2965-4809-bc4b-b9af24a5d33a tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 947.801837] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 947.802238] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.802359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.802425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.802780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.802817] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.803134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.803134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.803134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.803305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.803305] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.277727] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 948.278305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.278673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.279074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.279419] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.279752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.280184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.280470] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.280674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.281035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.281116] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.286274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.286274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.286643] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.286779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.286846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.287018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.287111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.287208] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.289274] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.289451] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.289590] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.289795] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.290216] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.290423] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.290543] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.290749] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.290891] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.291181] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.291422] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.291539] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.291659] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.291791] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.291912] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.292037] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.294831] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.294965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.305931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.306121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.306166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.306479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.306572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.306854] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.306969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.307052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.307582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.307636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.307733] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 948.318770] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.318956] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.319112] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.319292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.319610] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.319785] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.319913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.320285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.320420] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3c1b75-66bb-4b9e-9182-cc9248a972f1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.338784] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.338784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.338784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.338784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.338784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.347842] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 948.794279] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.823264] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.823536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.823685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.824060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.824284] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.824424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 4c3c1b75-66bb-4b9e-9182-cc9248a972f1 not found, creating... [ 948.824714] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.824881] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.825000] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.825266] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.825418] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.825753] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.825915] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.826099] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.826367] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.826641] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.826811] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 4c3c1b75-66bb-4b9e-9182-cc9248a972f1 is going to be created. [ 948.848374] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.848829] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.848829] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.848974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.849220] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.849448] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.296864] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.587570] env[66131]: INFO networking_nsxv3.common.synchronization [req-ec2988ad-277d-474f-b8c5-889c4036f6d7 req-233de4ec-5ffb-424d-9646-0a76be6347d9 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 949.587723] env[66131]: INFO networking_nsxv3.common.synchronization [req-ec2988ad-277d-474f-b8c5-889c4036f6d7 req-233de4ec-5ffb-424d-9646-0a76be6347d9 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 949.587858] env[66131]: INFO networking_nsxv3.common.synchronization [req-ec2988ad-277d-474f-b8c5-889c4036f6d7 req-233de4ec-5ffb-424d-9646-0a76be6347d9 service nova] Enqueued Resource ID: 4c3c1b75-66bb-4b9e-9182-cc9248a972f1 with Priority: HIGHEST for action port [ 949.588496] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 949.588613] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 949.588743] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3c1b75-66bb-4b9e-9182-cc9248a972f1 with Priority: HIGHEST for action port [ 949.589205] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.589362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.589436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.589626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.589706] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.590983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.591108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.591379] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.591683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.591683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.591863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.591990] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3c1b75-66bb-4b9e-9182-cc9248a972f1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.804020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.804340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.804391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.804737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.804737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.804885] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be updated. [ 949.842024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.842024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.842024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.842024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.842024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.849992] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: IN_PROGRESS for 2s [ 949.883612] env[66131]: INFO networking_nsxv3.common.synchronization [req-5360f90d-92bd-4c84-bc89-513d571ed85e req-dd5040c4-983d-4e38-8e48-df20fb4d5f29 tempest-MigrationsAdminTest-1398354370 tempest-MigrationsAdminTest-1398354370-project-member] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 949.884190] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGHEST for action security_group_members [ 949.884492] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.884637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.884719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.884979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.885439] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.885579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.885668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.885854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.885973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.886243] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.095541] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.096146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.099043] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c3c1b75-66bb-4b9e-9182-cc9248a972f1 with status ACTIVE [ 950.099043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.099043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.099043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.099966] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.100345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.100658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.100909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.101130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.102776] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c3c1b75-66bb-4b9e-9182-cc9248a972f1 is going to be updated. [ 950.124983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.125170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.125230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.127897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.127897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.127897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c3c1b75-66bb-4b9e-9182-cc9248a972f1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.363480] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 950.363942] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 950.363942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.364165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.364353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.364543] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.365290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.365290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.365290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.365290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.365290] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.389055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.389230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.389299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.389502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.419942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.420233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.420359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.420450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.420857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.420857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.420857] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be updated. [ 950.457553] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.457553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.457553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.458356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.458356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.469611] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: IN_PROGRESS for 2s [ 950.871736] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.374446] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.652122] env[66131]: INFO networking_nsxv3.common.synchronization [req-586ad843-2f1e-4e2c-927f-649049d94c1a req-7ee980a2-ae1e-4dec-96d1-403b65cbdb12 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 951.653041] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 951.653131] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.653253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.653332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.653623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.654252] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.654252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.654252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.654473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.654473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.654473] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.865957] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 951.866379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.866593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.866803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.866996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.867140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.867213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.867550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.867622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.868538] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.877347] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.877819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.877819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.877819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.878107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.878107] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 951.914995] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.914995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.914995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.914995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.914995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.925801] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 952.086779] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.087058] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.087242] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.087653] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.087916] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.088287] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.088428] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.088661] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.088808] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.089038] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.089169] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.089280] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.089386] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.089495] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.089675] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.089755] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.110270] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.110442] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.110614] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.110808] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.111222] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-ed1d4799-dec8-4bea-bdba-f2ec616b9214 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.111335] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.111426] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.111824] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.111983] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1d4799-dec8-4bea-bdba-f2ec616b9214',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.159014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.159014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.159014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.159014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.159014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.159014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.159014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.159014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.159559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.159808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.160017] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 already deleted. [ 952.160269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.370073] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.480785] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd68ac80-456d-40a6-bada-de320b838ff6 in Status: SUCCESS [ 952.481034] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 deletion is rescheduled due to dependency. [ 952.481114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.615063] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.615433] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.615614] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.616376] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.616376] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.616533] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port ed1d4799-dec8-4bea-bdba-f2ec616b9214 not found, creating... [ 952.616849] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.617168] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.617370] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.617660] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.618281] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.618378] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.619038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.619038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.619038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.619218] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.619453] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: ed1d4799-dec8-4bea-bdba-f2ec616b9214 is going to be created. [ 952.648784] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.649076] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.649202] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.649514] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.649795] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.650080] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.873861] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.373574] env[66131]: INFO networking_nsxv3.common.synchronization [req-586ad843-2f1e-4e2c-927f-649049d94c1a req-f89914b8-a9c5-492b-8e67-c2d93bd87afb service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 953.373915] env[66131]: INFO networking_nsxv3.common.synchronization [req-586ad843-2f1e-4e2c-927f-649049d94c1a req-f89914b8-a9c5-492b-8e67-c2d93bd87afb service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 953.373956] env[66131]: INFO networking_nsxv3.common.synchronization [req-586ad843-2f1e-4e2c-927f-649049d94c1a req-f89914b8-a9c5-492b-8e67-c2d93bd87afb service nova] Enqueued Resource ID: ed1d4799-dec8-4bea-bdba-f2ec616b9214 with Priority: HIGHEST for action port [ 953.374653] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 953.374836] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 953.374985] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed1d4799-dec8-4bea-bdba-f2ec616b9214 with Priority: HIGHEST for action port [ 953.375291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.375434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.375501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.375757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.375845] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.376838] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.376950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.377015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.377238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.377570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.377662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.377752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.377933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.378058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.378203] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.379407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed1d4799-dec8-4bea-bdba-f2ec616b9214 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.379584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.379737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.381254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.381254] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1d4799-dec8-4bea-bdba-f2ec616b9214',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.382157] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.382422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.382422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.383288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.383288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.383288] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be updated. [ 953.415707] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.415935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.416015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.416244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.416386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.428308] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: IN_PROGRESS for 2s [ 953.883058] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.887238] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.887238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.887238] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed1d4799-dec8-4bea-bdba-f2ec616b9214 with status ACTIVE [ 953.887464] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.887584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.887650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.887857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.887955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.888212] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.888864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.888864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.888968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.888968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.889277] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.889387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.889468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.889578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.889628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.889710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed1d4799-dec8-4bea-bdba-f2ec616b9214 is going to be updated. [ 953.914996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.915149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.915225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.915446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.915588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.915746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed1d4799-dec8-4bea-bdba-f2ec616b9214" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.939360] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 953.939360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.939360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.939360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.939360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.939360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.939360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.939625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.939625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.939625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.939709] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.389173] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.442294] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.442468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.442468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.443233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.443233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.443233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.443382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.444447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.444447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.444447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.444447] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.444447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.444447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.445890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.445890] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.445890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.445890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.445890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.445890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.445890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.446350] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.786552] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e268ed48-e944-462b-b1e6-647595fddb96 None None] Enqueued Resource ID: 06fc6294-b809-4db8-9617-9a7da4d32f44 with Priority: HIGHEST for action port [ 954.787989] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06fc6294-b809-4db8-9617-9a7da4d32f44 with Priority: HIGHEST for action port [ 954.787989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-06fc6294-b809-4db8-9617-9a7da4d32f44 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.788212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06fc6294-b809-4db8-9617-9a7da4d32f44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.788212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06fc6294-b809-4db8-9617-9a7da4d32f44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.788488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06fc6294-b809-4db8-9617-9a7da4d32f44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.788564] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06fc6294-b809-4db8-9617-9a7da4d32f44',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.892420] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.894036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.894036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.894036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.894036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.894036] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be created. [ 954.918971] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.919205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.919298] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.919484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.919698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.935595] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: UNINITIALIZED for 2s [ 954.951544] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6518e255-8a48-4fe6-8c80-b478b31e143a: rpc.has_security_group_logging(os_id): False [ 954.970215] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.970371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.970444] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.970668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.973824] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.973824] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.973824] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.973824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.974472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.974472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.974472] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 955.053041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.053041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.053278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.053455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.053609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.068921] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 955.293475] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06fc6294-b809-4db8-9617-9a7da4d32f44 [ 955.293475] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.293475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.293475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.293999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.293999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.293999] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06fc6294-b809-4db8-9617-9a7da4d32f44 already deleted. [ 955.293999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06fc6294-b809-4db8-9617-9a7da4d32f44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.436759] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 955.437174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.437174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.437282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.437435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.437554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.437617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.437797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.437882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.437970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.438141] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.438237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.438297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.438454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.438596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.438688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.438748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.438883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.438960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.439054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.439144] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.942029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d18d1e64-ca33-4d89-b4cf-d9d209fdd092: rpc.has_security_group_logging(os_id): False [ 955.960814] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.960980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.961068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.961287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.961379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.964611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.964611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.964611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.964611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.965442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.965442] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be created. [ 956.040918] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.040918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.040918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.040918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.040918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.054153] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: IN_PROGRESS for 2s [ 956.725788] env[66131]: INFO networking_nsxv3.common.synchronization [req-98ec5f4c-7342-492f-be60-336bf8fdcd6a req-dc9e7535-f9de-4465-9cbd-ebf3eb57b4e9 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 956.726400] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 956.726730] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.726849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.726931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.728210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.728297] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.728372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.731557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.731843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.731902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.732020] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.835077] env[66131]: INFO networking_nsxv3.common.synchronization [None req-357a9b7d-7fec-4cda-93f9-9c23c0b1a0c6 None None] Enqueued Resource ID: bf221125-8e71-45fd-91ac-3a968499420d with Priority: HIGHEST for action port [ 956.835077] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf221125-8e71-45fd-91ac-3a968499420d with Priority: HIGHEST for action port [ 956.835077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf221125-8e71-45fd-91ac-3a968499420d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.835077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf221125-8e71-45fd-91ac-3a968499420d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.835077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf221125-8e71-45fd-91ac-3a968499420d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.835732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf221125-8e71-45fd-91ac-3a968499420d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.835966] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf221125-8e71-45fd-91ac-3a968499420d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.947890] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.947890] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.947890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.947890] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.969541] env[66131]: INFO networking_nsxv3.common.synchronization [req-139c0c34-42ac-4e13-b176-08fa4733e91b req-50d0c653-daf1-415a-978c-61d91d905e3a tempest-ServerRescueTestJSON-1428891184 tempest-ServerRescueTestJSON-1428891184-project-member] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 956.970019] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 956.970569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.970765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.970765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.971119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.971119] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.971219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.971408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.971408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.971475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.971565] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.084178] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 957.084602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.106648] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.106849] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.106987] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.108870] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.108870] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.108870] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.109113] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.109263] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.109263] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.109263] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.109263] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.109263] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.109263] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.109263] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.110312] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.110312] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.134864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.135100] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.135262] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.135535] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.136014] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-e970fcdf-acd2-4afa-b257-16ee6a46fb62 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.136306] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.136516] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.136992] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.137241] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e970fcdf-acd2-4afa-b257-16ee6a46fb62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.363910] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.364279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.364975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.364975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.364975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.365447] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.365447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.365588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.366338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.366338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.366338] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 already deleted. [ 957.366338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.367665] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf221125-8e71-45fd-91ac-3a968499420d [ 957.367903] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.368075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.368179] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.368443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.368574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.368717] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf221125-8e71-45fd-91ac-3a968499420d already deleted. [ 957.368869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf221125-8e71-45fd-91ac-3a968499420d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.450148] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.450356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.450435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.450680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.450855] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.450957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.451039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.451202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.451299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.451409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.451583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.451809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.452038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.452249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.452625] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.452625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.452924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.452924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.453082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.453233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.453332] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.473644] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.639983] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.640291] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.640432] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.640712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.640856] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.641051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port e970fcdf-acd2-4afa-b257-16ee6a46fb62 not found, creating... [ 957.641338] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.641494] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.641610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.641869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.642035] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.642385] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.642544] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.642655] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.642863] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.642996] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.643182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: e970fcdf-acd2-4afa-b257-16ee6a46fb62 is going to be created. [ 957.670188] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.670388] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.670524] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.670785] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.671046] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.671331] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.956454] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95303b6-7e26-444d-bfa3-5518dbc80e21: rpc.has_security_group_logging(os_id): False [ 957.976997] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.976997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.976997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.977247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.977284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.977460] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.977554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.977624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.977789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.977867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.978060] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.978152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.978211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.978363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.978449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.978622] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.978708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.978759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.978893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.978965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.979061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be created. [ 957.980228] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.071291] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 958.071549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.071759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.071996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.072101] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.073702] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.073838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.073935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.074099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.074299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.084779] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 958.426648] env[66131]: INFO networking_nsxv3.common.synchronization [req-98ec5f4c-7342-492f-be60-336bf8fdcd6a req-54b1e00e-31bf-4cac-aa14-894f53e370d6 service nova] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 958.426648] env[66131]: INFO networking_nsxv3.common.synchronization [req-98ec5f4c-7342-492f-be60-336bf8fdcd6a req-54b1e00e-31bf-4cac-aa14-894f53e370d6 service nova] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 958.426648] env[66131]: INFO networking_nsxv3.common.synchronization [req-98ec5f4c-7342-492f-be60-336bf8fdcd6a req-54b1e00e-31bf-4cac-aa14-894f53e370d6 service nova] Enqueued Resource ID: e970fcdf-acd2-4afa-b257-16ee6a46fb62 with Priority: HIGHEST for action port [ 958.430803] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 958.430803] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 958.430803] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e970fcdf-acd2-4afa-b257-16ee6a46fb62 with Priority: HIGHEST for action port [ 958.430803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.430803] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.430803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.430803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.430803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.431698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.431698] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.431698] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.431991] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e970fcdf-acd2-4afa-b257-16ee6a46fb62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.432125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.432180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.432343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.432514] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e970fcdf-acd2-4afa-b257-16ee6a46fb62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.482927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.483657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.483657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.483657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.483657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.483657] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be updated. [ 958.516688] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.518131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.518131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.518131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.518131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.529850] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: IN_PROGRESS for 2s [ 958.576402] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.576638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.576699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.576891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.577123] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.577228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.577295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.577459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.577586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.577666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.577748] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.934948] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.935125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.935313] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e970fcdf-acd2-4afa-b257-16ee6a46fb62 with status ACTIVE [ 958.936160] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.936160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.936160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.936160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.936160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.936160] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.936794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.936794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.936794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.936794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.937150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.937150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.937150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.937324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.937369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.937508] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e970fcdf-acd2-4afa-b257-16ee6a46fb62 is going to be updated. [ 958.938644] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.962961] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.964246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.964246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.964246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.964246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.964246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e970fcdf-acd2-4afa-b257-16ee6a46fb62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.080545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.080720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.080762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.080970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.081149] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.081250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.081349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.081455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.081542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.081625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.081784] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.082844] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.082844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.082844] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.440913] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.587222] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d18d1e64-ca33-4d89-b4cf-d9d209fdd092: rpc.has_security_group_logging(os_id): False [ 959.607226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.607226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.607226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.607226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.608024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.608286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.608788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.609125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.609362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.609582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be updated. [ 959.688429] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.688619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.688895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.689296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.689471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.704239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: IN_PROGRESS for 2s [ 959.943786] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.944060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.944143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.944375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.944474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.944605] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be created. [ 959.974704] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.975184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.975184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.975280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.975432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.986424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: UNINITIALIZED for 2s [ 960.100429] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 960.100679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.541080] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 960.541375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.719244] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 961.719530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.999477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.999477] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.999477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.999477] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.502729] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.007018] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a68adb37-f05f-44c4-a13b-7eb7bc0ab766: rpc.has_security_group_logging(os_id): False [ 963.034516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.034734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.035477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.035477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.035674] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.035674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.035799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.035912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.035970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.036039] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be created. [ 963.114600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.114770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.115098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.115289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.115345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.130090] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 963.428566] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 963.428688] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 964.255189] env[66131]: INFO networking_nsxv3.common.synchronization [req-fbafb546-7daa-41fd-af91-44503f3fb994 req-e591294d-8408-4d05-a95d-edf5f50f084b tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 964.255976] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 964.256377] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.256509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.256610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.256845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.257016] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.257484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.257586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.257856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.257951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.258082] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.645904] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.646234] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.646366] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.647408] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.647709] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.647964] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.648093] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.648271] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.648379] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.648612] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.648691] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.648795] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.648900] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.649017] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.649125] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.649251] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.668988] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.669628] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.669628] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.669628] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-971" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.669870] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-d14b3ca6-0861-4a8f-b061-500757c2e27f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.669974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.670094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.670440] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.670580] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d14b3ca6-0861-4a8f-b061-500757c2e27f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.762678] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.762678] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.762678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.762678] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 964.791361] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.791522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.791595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.791838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.792080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.802910] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 965.141994] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 965.142373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.174751] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.175017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.175170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.175515] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.175700] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.175856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port d14b3ca6-0861-4a8f-b061-500757c2e27f not found, creating... [ 965.176139] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.176303] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.176418] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.176688] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.176831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.177170] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.177331] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.177498] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.177802] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.177988] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.178180] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: d14b3ca6-0861-4a8f-b061-500757c2e27f is going to be created. [ 965.200496] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.200775] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.200844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.201115] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.201346] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.201567] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.009812] env[66131]: INFO networking_nsxv3.common.synchronization [req-fbafb546-7daa-41fd-af91-44503f3fb994 req-f63a5f89-a026-4693-86c5-b66c4d9192f1 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 966.010034] env[66131]: INFO networking_nsxv3.common.synchronization [req-fbafb546-7daa-41fd-af91-44503f3fb994 req-f63a5f89-a026-4693-86c5-b66c4d9192f1 service nova] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 966.010186] env[66131]: INFO networking_nsxv3.common.synchronization [req-fbafb546-7daa-41fd-af91-44503f3fb994 req-f63a5f89-a026-4693-86c5-b66c4d9192f1 service nova] Enqueued Resource ID: d14b3ca6-0861-4a8f-b061-500757c2e27f with Priority: HIGHEST for action port [ 966.010722] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_rules [ 966.010854] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 966.010955] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d14b3ca6-0861-4a8f-b061-500757c2e27f with Priority: HIGHEST for action port [ 966.011331] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.011484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.011528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.011706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.011787] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.013463] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.013585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.013805] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d14b3ca6-0861-4a8f-b061-500757c2e27f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.013944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.014022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.014253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.014353] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d14b3ca6-0861-4a8f-b061-500757c2e27f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.516774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.516917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.517040] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d14b3ca6-0861-4a8f-b061-500757c2e27f with status ACTIVE [ 966.517176] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.517278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.517341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.517552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.517638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.518075] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.518075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.518075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.518270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.518301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.519022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.519022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.519022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.519022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.519022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.519022] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d14b3ca6-0861-4a8f-b061-500757c2e27f is going to be updated. [ 966.540511] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.540741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.540741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.540950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.541101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.541252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d14b3ca6-0861-4a8f-b061-500757c2e27f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.822504] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 966.822677] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 966.822784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.822963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.823278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.823500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.823636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.823730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.823879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.824013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.824116] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.330763] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.546680] env[66131]: INFO networking_nsxv3.common.synchronization [req-5a258277-7898-4cfb-8ca4-d763f77a7c71 req-98bd7ced-e933-42e3-8eec-0f5b08b9e582 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 967.547352] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 967.547690] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.547803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.547871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.548835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.549498] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.549715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.549829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.550091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.550240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.550380] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.833768] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.052612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.052754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.052794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.053066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.053169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.053401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.053508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.053580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.053746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.053823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.053965] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 968.087597] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.087796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.087796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.087945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.088114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.103448] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 968.339075] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.339075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.339075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.339075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.339075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.339075] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 968.376041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.376237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.376237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.376357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.376502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.386970] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 970.112880] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 970.113288] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 970.113288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.397029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 970.397229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.397348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.397572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.397816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.397950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.398024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.398236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.398338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.398428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.398519] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.901274] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.901471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.901538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.901764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.901983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.902102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.902162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.902400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.902400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.902505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.902661] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.902770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.902856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.902971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.903182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.903312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.903394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.903543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.903676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.903751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.903842] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.406441] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4e8c15-6df2-42fb-824c-bb556c5b499a: rpc.has_security_group_logging(os_id): False [ 971.429307] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.429410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.429459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.429649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.429741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.429958] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.430359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.430485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.430708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.430837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.431186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.431349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.431610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.431873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.432133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.432585] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.432772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.432982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.433186] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.433322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.433372] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 971.511958] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.512227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.512346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.512637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.512842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.530227] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 972.548963] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 972.549271] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 973.544454] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 973.544688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.870242] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-8a016f95-5bff-44ce-812e-90ec37b2f3b2 tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 973.871681] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 973.871681] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.871681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.871681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.871681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.871681] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.871681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.871681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.872420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.872420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.872420] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.256618] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.256873] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.257098] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.257484] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.257784] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.257949] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.258098] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.258344] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.258495] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.258711] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.258841] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.258958] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.259079] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.259190] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.259300] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.259442] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.281685] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.281945] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.282243] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.282473] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.283175] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-92478bbf-cd51-4d4c-8fc4-69634809e680 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.283421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.283604] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.284101] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.284267] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92478bbf-cd51-4d4c-8fc4-69634809e680',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.375297] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.375569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.375681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.375880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.375972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.376193] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.376284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.376374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.376494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.376568] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.376652] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 974.405569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.405799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.405799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.406089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.406272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.416219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 974.791087] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.791381] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.791537] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.791904] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.792104] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.792268] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 92478bbf-cd51-4d4c-8fc4-69634809e680 not found, creating... [ 974.792595] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.792797] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.792938] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.793210] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.793433] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.793741] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.793896] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.794081] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.794393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.794554] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.794693] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 92478bbf-cd51-4d4c-8fc4-69634809e680 is going to be created. [ 974.816929] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.817271] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.817475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.817812] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.818116] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.818400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.580453] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-56e0f290-2257-4c71-8528-fb557d42f398 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 975.580453] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-56e0f290-2257-4c71-8528-fb557d42f398 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 975.580946] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-56e0f290-2257-4c71-8528-fb557d42f398 service nova] Enqueued Resource ID: 92478bbf-cd51-4d4c-8fc4-69634809e680 with Priority: HIGHEST for action port [ 975.581191] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 975.581350] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 975.581456] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92478bbf-cd51-4d4c-8fc4-69634809e680 with Priority: HIGHEST for action port [ 975.581753] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.581864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.581932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.582228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.582315] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.583538] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.583720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.584044] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-92478bbf-cd51-4d4c-8fc4-69634809e680 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.584200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.584302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.584466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.584548] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92478bbf-cd51-4d4c-8fc4-69634809e680',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.087011] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.087479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.087644] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92478bbf-cd51-4d4c-8fc4-69634809e680 with status ACTIVE [ 976.087886] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.088327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.088327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.088445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.088527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.088722] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.088828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.088892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.089155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.089269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.089578] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.089578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.089682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.089760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.089827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.089942] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92478bbf-cd51-4d4c-8fc4-69634809e680 is going to be updated. [ 976.120565] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.120565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.120874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.120874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.121012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.121252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92478bbf-cd51-4d4c-8fc4-69634809e680" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.430506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 976.432167] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 deletion is rescheduled due to dependency. [ 976.432167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.432167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.432167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.432167] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.432167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.432167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.432474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.432474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.432535] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.936027] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.439582] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.942624] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.942927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.942927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.944629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.944832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.944978] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 978.017886] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-2549bae4-0a81-44f8-9e17-d01e163a525d tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 978.018691] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 978.018859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.018997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.026433] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.026433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.026433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.026433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.026433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.039929] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 978.498922] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.499149] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.499284] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.499556] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.499924] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.500404] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.500630] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.500969] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.501253] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.501497] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.501625] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.501732] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.501849] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.501957] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.502075] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.502216] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.522671] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.522848] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.522980] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.523183] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-144" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.523600] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-61498051-00e7-440f-b0b4-ab6f497226ce taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.523723] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.523785] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.524177] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.524347] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61498051-00e7-440f-b0b4-ab6f497226ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.026615] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.026881] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.027086] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.027272] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.027419] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.027606] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 61498051-00e7-440f-b0b4-ab6f497226ce not found, creating... [ 979.027862] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.028025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.028139] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.028387] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.028532] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.028861] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.029053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.029246] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.029452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.029583] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.029716] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 61498051-00e7-440f-b0b4-ab6f497226ce is going to be created. [ 979.049919] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.050166] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.050349] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.050635] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.050863] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.051094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.793050] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-1c250599-5151-41dd-9fe9-d3c5eb2b2052 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 979.793270] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-1c250599-5151-41dd-9fe9-d3c5eb2b2052 service nova] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 979.793424] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c3556e5-49d3-44d8-9816-6f16e2f9f488 req-1c250599-5151-41dd-9fe9-d3c5eb2b2052 service nova] Enqueued Resource ID: 61498051-00e7-440f-b0b4-ab6f497226ce with Priority: HIGHEST for action port [ 979.794688] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_rules [ 979.794991] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 979.795146] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61498051-00e7-440f-b0b4-ab6f497226ce with Priority: HIGHEST for action port [ 979.795500] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.795717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.796113] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.796293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.796523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-61498051-00e7-440f-b0b4-ab6f497226ce taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.797027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.797114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.797335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.797416] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61498051-00e7-440f-b0b4-ab6f497226ce',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.052876] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 980.053323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.053562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.054617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.054617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.054617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.054617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.054849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.054910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.054947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.055874] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.057076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.057167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.057381] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.057531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.057531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.057893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.057893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.057893] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.299458] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61498051-00e7-440f-b0b4-ab6f497226ce with status ACTIVE [ 980.299870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.300668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.300803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.301049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.301183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.301993] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.301993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.301993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.301993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.301993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.301993] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.302366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.302366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.302366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.302366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.302556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61498051-00e7-440f-b0b4-ab6f497226ce is going to be updated. [ 980.324505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.324644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.324710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.326200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.326200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.326200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61498051-00e7-440f-b0b4-ab6f497226ce" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.559989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.560251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.560804] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.860199] env[66131]: INFO networking_nsxv3.common.synchronization [None req-72dcb8a0-80dd-4a04-b487-c59621836303 None None] Enqueued Resource ID: 86a58abe-7aec-4f6b-af3c-0c92a0e647ca with Priority: HIGHEST for action port [ 980.860838] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a58abe-7aec-4f6b-af3c-0c92a0e647ca with Priority: HIGHEST for action port [ 980.862053] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a58abe-7aec-4f6b-af3c-0c92a0e647ca taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.862053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a58abe-7aec-4f6b-af3c-0c92a0e647ca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.862053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a58abe-7aec-4f6b-af3c-0c92a0e647ca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.862053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a58abe-7aec-4f6b-af3c-0c92a0e647ca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.862277] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a58abe-7aec-4f6b-af3c-0c92a0e647ca',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.063778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.180413] env[66131]: INFO networking_nsxv3.common.synchronization [None req-9dfe6b94-c0dc-4ae6-b835-64f5571287d9 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 981.180993] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 981.181438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.181548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.181548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.181838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.181917] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.302589] env[66131]: INFO networking_nsxv3.common.synchronization [None req-0a4e8d77-c495-4ee7-9cd5-1ecd2afb202d tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 981.303179] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 981.305430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.305430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.365561] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86a58abe-7aec-4f6b-af3c-0c92a0e647ca [ 981.365561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.365561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.365561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.365561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.365561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.365561] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86a58abe-7aec-4f6b-af3c-0c92a0e647ca already deleted. [ 981.365561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a58abe-7aec-4f6b-af3c-0c92a0e647ca" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.567384] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.567384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.567589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.567692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.567798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.567902] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 981.601894] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.601894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.601894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.601894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.602207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.615968] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 981.711789] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.712051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.712133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.712424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.712509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.713275] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e already deleted. [ 981.713275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.713275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.713275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.713275] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.234550] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.234908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.234908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.234977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.235218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.235218] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e already deleted. [ 982.235218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.492259] env[66131]: INFO networking_nsxv3.common.synchronization [req-68ab6fb3-0007-486a-953a-a3a67ec3806f req-23a6bf7c-4c96-44a1-8017-3ad27cfd3e1f tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 982.492844] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 982.493485] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.493485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.493650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.493807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.493984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.494232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.494286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.494450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.494543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.494638] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.925311] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.926421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.926421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.926421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.926421] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.926421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.926697] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.926924] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.926924] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.927122] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.927231] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.927329] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.927435] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.927543] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.927645] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.927856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.950428] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.950428] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.950428] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.950428] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.950979] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-948e9566-c4a9-4e23-aa58-db0dfc207a23 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.950979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.950979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.951324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.951897] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('948e9566-c4a9-4e23-aa58-db0dfc207a23',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.998334] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.998334] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.998334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.998334] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 already deleted. [ 982.998805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.355413] env[66131]: INFO networking_nsxv3.common.synchronization [None req-95826f70-e57f-4f06-be39-0383d8cd0f0e None None] Enqueued Resource ID: 20d0ce9b-faf0-46aa-891e-2e4f021f76f2 with Priority: HIGHEST for action port [ 983.356953] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d0ce9b-faf0-46aa-891e-2e4f021f76f2 with Priority: HIGHEST for action port [ 983.357149] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-20d0ce9b-faf0-46aa-891e-2e4f021f76f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.357290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20d0ce9b-faf0-46aa-891e-2e4f021f76f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.357391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20d0ce9b-faf0-46aa-891e-2e4f021f76f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.357703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20d0ce9b-faf0-46aa-891e-2e4f021f76f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.357703] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20d0ce9b-faf0-46aa-891e-2e4f021f76f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.453812] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.454078] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.454201] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.456458] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 948e9566-c4a9-4e23-aa58-db0dfc207a23 not found, creating... [ 983.456458] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.456458] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.456458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.456925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.456925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.456925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.456925] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 is going to be created. [ 983.477717] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.478077] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.478259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.478593] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.479857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.479857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.630438] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 983.630616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.630666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.630912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.631101] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.631213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.631337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.631425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.631502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.631835] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.862022] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20d0ce9b-faf0-46aa-891e-2e4f021f76f2 [ 983.862022] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.862022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.862022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.862022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.862022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.862022] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20d0ce9b-faf0-46aa-891e-2e4f021f76f2 already deleted. [ 983.862022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20d0ce9b-faf0-46aa-891e-2e4f021f76f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.940999] env[66131]: INFO networking_nsxv3.common.synchronization [req-32b64aaf-a8b1-4945-8119-fcaadc696ea0 req-967cf374-e79e-4790-95c3-f5521817b26c tempest-ServerRescueTestJSON-1428891184 tempest-ServerRescueTestJSON-1428891184-project-member] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 983.941627] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGHEST for action security_group_members [ 983.942056] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.942291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.942391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.942626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.942820] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.942973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.943067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.943218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.943331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.943448] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.134753] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.273603] env[66131]: INFO networking_nsxv3.common.synchronization [req-68ab6fb3-0007-486a-953a-a3a67ec3806f req-bbbbeed7-6591-4661-bca8-f447def6d176 service nova] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 984.273857] env[66131]: INFO networking_nsxv3.common.synchronization [req-68ab6fb3-0007-486a-953a-a3a67ec3806f req-bbbbeed7-6591-4661-bca8-f447def6d176 service nova] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 984.274222] env[66131]: INFO networking_nsxv3.common.synchronization [req-68ab6fb3-0007-486a-953a-a3a67ec3806f req-bbbbeed7-6591-4661-bca8-f447def6d176 service nova] Enqueued Resource ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 with Priority: HIGHEST for action port [ 984.277330] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 984.277330] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 984.277330] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 with Priority: HIGHEST for action port [ 984.277330] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.277330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.277330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.277330] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.277330] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.279292] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.279527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.279650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.280073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.280382] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.281210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.281210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.281210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.281210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.281210] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.282817] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-948e9566-c4a9-4e23-aa58-db0dfc207a23 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.282817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.282817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.283111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.283252] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('948e9566-c4a9-4e23-aa58-db0dfc207a23',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.445434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.445730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.445730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.446113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.446219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.446471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.448076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.448187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.448436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.448548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.448872] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be updated. [ 984.481217] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.481422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.481513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.482275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.482511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.493282] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: IN_PROGRESS for 2s [ 984.637199] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.785911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.786077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.786285] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.787266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 948e9566-c4a9-4e23-aa58-db0dfc207a23 with status ACTIVE [ 984.787508] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.787738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.787738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.788015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.788093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.788271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.788402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.788463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.789818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.789908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.790172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.790314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.790383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.790504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.790569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.790662] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 is going to be updated. [ 984.817364] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.817563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.817604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.817918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.817918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.818298] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.096114] env[66131]: INFO networking_nsxv3.common.synchronization [req-9afd3395-c888-4ac8-ace0-5acce5696f4f req-e30f8e81-e1b4-436d-9f85-9dfd76a81735 tempest-InstanceActionsTestJSON-1165562785 tempest-InstanceActionsTestJSON-1165562785-project-member] Enqueued Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_members [ 985.096114] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_members [ 985.096114] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.096524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.096713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.097219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.098047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.098047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.098047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.098710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.098710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.098710] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.140045] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.140343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.140494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.140771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.140922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.141089] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 985.170529] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.170969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.170969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.170969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.171105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.181516] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 985.228550] env[66131]: INFO networking_nsxv3.common.synchronization [req-761ea363-24f7-4682-af26-8df4bd0c3a00 req-0e44a08d-2d7f-4cca-af7f-bd4b215c11a1 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 985.229167] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 985.229482] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.229601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.229668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.229870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.231518] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.231742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.231859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.232377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.232377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.232377] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.294174] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.518650] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-338 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.519049] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.519290] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.519895] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.520344] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.520596] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.520768] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.521028] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.521211] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.521446] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.521561] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.521668] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.521772] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.521870] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.522020] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.522168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.545594] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.545806] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.545997] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.546280] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-338" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.546846] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.547096] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.547241] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.547668] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.548245] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb50dfbe-d630-44bf-aa8f-f7fb462f583f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.601888] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.602164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.602247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.602531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.602670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.602977] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.603157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.603271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.603501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.603639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.603745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb89a8f-6be5-416d-bcac-1126e3f58519 already deleted. [ 985.603872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.657068] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.657296] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.657421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.657696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.657960] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.658176] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.658238] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.658435] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.658576] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.658777] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.658889] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.658994] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.659113] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.659223] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.659330] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.659472] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.681717] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.681969] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.682087] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.682297] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.683538] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-d0c949d6-6278-4b30-a35b-b05f6d06c530 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.683538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.683538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.683538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.683538] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0c949d6-6278-4b30-a35b-b05f6d06c530',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.736671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.736671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.736671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.736910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.762975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.763119] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.763302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.763439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.763757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.763934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.764168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 985.793852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.793852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.793852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.793852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.793852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.797855] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.798010] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.798096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.798295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.798388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.798476] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 is going to be created. [ 985.804652] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 985.823019] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.823237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.823237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.823420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.823795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.833261] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: UNINITIALIZED for 2s [ 986.050941] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.051155] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.051346] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.051807] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.052025] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.052358] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port fb50dfbe-d630-44bf-aa8f-f7fb462f583f not found, creating... [ 986.052739] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.052956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.053120] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.053366] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.053549] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.053942] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.054232] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.054368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.054606] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.054745] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.054885] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: fb50dfbe-d630-44bf-aa8f-f7fb462f583f is going to be created. [ 986.078510] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.078828] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.078965] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.079300] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.079569] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.079857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.187573] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.187956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.187956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.188314] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.188479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.188671] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port d0c949d6-6278-4b30-a35b-b05f6d06c530 not found, creating... [ 986.189295] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.189295] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.189465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.189713] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.189866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.190236] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.190485] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.190576] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.190841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.191036] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.191219] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: d0c949d6-6278-4b30-a35b-b05f6d06c530 is going to be created. [ 986.221456] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.221662] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.221778] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.222316] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.222516] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.222753] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.504024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 in Status: SUCCESS [ 986.504393] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 deletion is rescheduled due to dependency. [ 986.504579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.767302] env[66131]: INFO networking_nsxv3.common.synchronization [req-9afd3395-c888-4ac8-ace0-5acce5696f4f req-17278527-690d-4d3a-bc3e-4b000540d4c2 service nova] Enqueued Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_rules [ 986.767575] env[66131]: INFO networking_nsxv3.common.synchronization [req-9afd3395-c888-4ac8-ace0-5acce5696f4f req-17278527-690d-4d3a-bc3e-4b000540d4c2 service nova] Enqueued Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_members [ 986.767575] env[66131]: INFO networking_nsxv3.common.synchronization [req-9afd3395-c888-4ac8-ace0-5acce5696f4f req-17278527-690d-4d3a-bc3e-4b000540d4c2 service nova] Enqueued Resource ID: fb50dfbe-d630-44bf-aa8f-f7fb462f583f with Priority: HIGHEST for action port [ 986.768744] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_rules [ 986.768744] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_members [ 986.768744] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb50dfbe-d630-44bf-aa8f-f7fb462f583f with Priority: HIGHEST for action port [ 986.768744] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.768744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.769129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.769129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.769199] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.770124] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.770223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.770223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.770950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.770950] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.770950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.770950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.770950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.770950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.771279] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.771808] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.772720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.772720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.772720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.772720] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb50dfbe-d630-44bf-aa8f-f7fb462f583f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.898567] env[66131]: INFO networking_nsxv3.common.synchronization [req-761ea363-24f7-4682-af26-8df4bd0c3a00 req-9672dd9d-dd19-4876-8c41-da4bc49a8fb6 service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 986.898827] env[66131]: INFO networking_nsxv3.common.synchronization [req-761ea363-24f7-4682-af26-8df4bd0c3a00 req-9672dd9d-dd19-4876-8c41-da4bc49a8fb6 service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 986.900183] env[66131]: INFO networking_nsxv3.common.synchronization [req-761ea363-24f7-4682-af26-8df4bd0c3a00 req-9672dd9d-dd19-4876-8c41-da4bc49a8fb6 service nova] Enqueued Resource ID: d0c949d6-6278-4b30-a35b-b05f6d06c530 with Priority: HIGHEST for action port [ 986.900801] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 986.901098] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 986.901669] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0c949d6-6278-4b30-a35b-b05f6d06c530 with Priority: HIGHEST for action port [ 986.901892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.901892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.902026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.902328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.902485] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.904562] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.904562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.904562] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0c949d6-6278-4b30-a35b-b05f6d06c530 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.904562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.904562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.904799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.904799] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0c949d6-6278-4b30-a35b-b05f6d06c530',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.191660] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 987.191886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.192175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.192384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.192611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.192737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.192807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.193013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.193052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.193129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.193286] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.193400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.193467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.193623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.193775] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.193884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.193949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.194217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.194217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.194280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.194365] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.274052] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.275492] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.275647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.275852] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb50dfbe-d630-44bf-aa8f-f7fb462f583f with status ACTIVE [ 987.276072] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.277343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.277343] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.277343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.277903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.277903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.277903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.277903] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb50dfbe-d630-44bf-aa8f-f7fb462f583f is going to be updated. [ 987.300719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.300924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.300965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.301199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.301365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.301520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb50dfbe-d630-44bf-aa8f-f7fb462f583f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.406767] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.406937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.407214] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0c949d6-6278-4b30-a35b-b05f6d06c530 with status ACTIVE [ 987.407446] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.407563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.407659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.407894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.408039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.408235] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.408393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.408514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.408652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.408765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.408983] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.409133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.409204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.409399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.409497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.409587] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0c949d6-6278-4b30-a35b-b05f6d06c530 is going to be updated. [ 987.433582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.433797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.433868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.434309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.434509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.434714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0c949d6-6278-4b30-a35b-b05f6d06c530" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.699048] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcda49b5-8fd1-462d-976a-a25d59236231: rpc.has_security_group_logging(os_id): False [ 987.718353] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.718601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.718601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.718799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.718886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.719098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.719196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.719258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.719408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.719484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.719669] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.719759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.719820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.719956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.720041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.720237] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.720344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.720423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.720562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.720635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.720735] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 987.781027] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.798215] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.798462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.798512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.798713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.798861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.813950] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 987.813950] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e deletion is rescheduled due to dependency. [ 987.813950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.814306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.814306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.814496] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.814617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.814682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.814831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.814904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.814995] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.818095] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 987.842082] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: SUCCESS [ 987.842326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.842486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.842694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.842906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.843031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.843098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.843251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.843333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.843417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.843508] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.283269] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.283487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.283553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.283769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.283870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.283973] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb89a8f-6be5-416d-bcac-1126e3f58519 is going to be created. [ 988.318081] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.324919] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.324919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.324919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.324919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.324919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.336511] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb89a8f-6be5-416d-bcac-1126e3f58519 in Status: UNINITIALIZED for 2s [ 988.346039] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.820425] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.847174] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 635d180a-1a27-4897-8f2c-a14eca9102c1: rpc.has_security_group_logging(os_id): False [ 988.866942] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.868012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.868012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.868012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.868012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.868012] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.868012] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.868295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.868295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.868295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.868395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 is going to be created. [ 988.935245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.935479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.935540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.935738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.935937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.951880] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: IN_PROGRESS for 2s [ 989.323663] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.323867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.323925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.324228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.324396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.324511] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 989.357916] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.358076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.358148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.358354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.358494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.367683] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 989.837336] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 989.837336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.837336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.838024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.838024] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.341927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.341927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.341927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.341927] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.355169] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb89a8f-6be5-416d-bcac-1126e3f58519 in Status: SUCCESS [ 990.355540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.356666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.357034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.357290] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.357764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.357876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.357993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.358228] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.614978] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.615254] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.615821] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.615821] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.616029] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.616240] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.616342] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.616637] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.616811] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.617064] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.617212] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.617643] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.617643] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.617751] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.617799] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.618374] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.639337] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.639627] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.639823] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.639995] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-770" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.640347] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-fe31c11e-3a38-45cd-a499-a846a487aa48 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.640510] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.640629] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.640892] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.641040] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe31c11e-3a38-45cd-a499-a846a487aa48',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.826687] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5954545a-349a-460c-8c92-91ba58f04001 tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_rules [ 990.828257] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_rules [ 990.829208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.829208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.829208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.829755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.829955] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.843806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.844269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.844269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.844597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.844881] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.845070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.845251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.845658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.845812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.846077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.846249] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.846455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.846653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.846759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.846984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.847149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.847236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.847472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.847591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.847720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.847872] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.861556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.861807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.861883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.862164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.862411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.862559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.862651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.862881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.863016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.863158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.863389] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.863552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.863648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.863868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.864093] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.864388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.864458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.864692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.864856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.864989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.865143] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.965541] env[66131]: INFO networking_nsxv3.common.synchronization [None req-1bcfb76e-0460-471b-b879-2ada8a70f2a6 tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_rules [ 990.966503] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_rules [ 990.966654] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.966654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.970268] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: SUCCESS [ 990.970700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.143924] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.144390] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.144642] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.144925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.145129] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.145590] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.145684] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.145757] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.145986] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.146141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.146498] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.146611] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.146732] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.146943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.147089] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.147233] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: fe31c11e-3a38-45cd-a499-a846a487aa48 is going to be updated. [ 991.172769] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.172986] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.173129] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.173470] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.173725] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.173973] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.350744] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcda49b5-8fd1-462d-976a-a25d59236231: rpc.has_security_group_logging(os_id): False [ 991.353675] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.353843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.353890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.354146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.354246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.354349] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 already deleted. [ 991.354439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.354617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.354796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.354882] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.367925] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efb89a8f-6be5-416d-bcac-1126e3f58519: rpc.has_security_group_logging(os_id): False [ 991.389505] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 991.389754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.389908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.390181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.390372] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.390507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.390572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.390744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.390830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.390948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.391107] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.392859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.393019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.393074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.393248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.393322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.393513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.393606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.393663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.393813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.393884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.394083] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.394250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.394310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.394453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.394528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.394738] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.394830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.394880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.395034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.395203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.395599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 991.409851] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.410105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.410184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.410598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.410746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.411025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.411197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.411238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.411480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.411642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.412176] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.412307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.412423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.412682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.412778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.413111] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.413302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.413441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.413735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.413886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.414050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efb89a8f-6be5-416d-bcac-1126e3f58519 is going to be created. [ 991.527397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.527670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.527670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.527972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.528265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.539459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.539715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.539805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.540198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.541929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.548498] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efb89a8f-6be5-416d-bcac-1126e3f58519 in Status: IN_PROGRESS for 2s [ 991.563700] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 991.797052] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0a633c7-2c28-4c9f-a815-97a3c4995bfe req-c77ea435-c160-41c7-abbb-b4ab8121dcf0 tempest-ImagesTestJSON-1473947954 tempest-ImagesTestJSON-1473947954-project-member] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 991.797507] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGHEST for action security_group_members [ 991.798351] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.798513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.798621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.798846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.799037] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.799171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.799247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.800211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.800211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.800211] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.877938] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.878352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.878352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.878563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.878888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.878888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 already deleted. [ 991.879017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.898549] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.898732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.898951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.899225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.899327] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.899418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.899512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.899636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.899725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.899814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.899967] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.900100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.900172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.901071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.901071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.901071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.901071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.901071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.901071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.901071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.901071] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.903745] env[66131]: INFO networking_nsxv3.common.synchronization [req-3ae72d35-c650-47dc-aea4-70346659f7ea req-ef9b066f-c4c3-4be4-a18d-b5e2559a90df service nova] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_rules [ 991.903928] env[66131]: INFO networking_nsxv3.common.synchronization [req-3ae72d35-c650-47dc-aea4-70346659f7ea req-ef9b066f-c4c3-4be4-a18d-b5e2559a90df service nova] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 991.904270] env[66131]: INFO networking_nsxv3.common.synchronization [req-3ae72d35-c650-47dc-aea4-70346659f7ea req-ef9b066f-c4c3-4be4-a18d-b5e2559a90df service nova] Enqueued Resource ID: fe31c11e-3a38-45cd-a499-a846a487aa48 with Priority: HIGHEST for action port [ 991.904361] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_rules [ 991.904468] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 991.904561] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe31c11e-3a38-45cd-a499-a846a487aa48 with Priority: HIGHEST for action port [ 991.905391] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.905512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.905579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.905757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.905838] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.906722] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.906862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.906862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.907052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.907179] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.907272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.907328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.907468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.907551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.907642] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.908423] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe31c11e-3a38-45cd-a499-a846a487aa48 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.908538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.908594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.908735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.908815] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe31c11e-3a38-45cd-a499-a846a487aa48',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.250216] env[66131]: INFO networking_nsxv3.common.synchronization [req-34539ed5-1604-4a9c-bd9b-7a17b1af3647 req-b8f20239-aa25-4f80-b847-e3d8d08328f2 tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 992.250823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 992.251191] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.251388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.251454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.251665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.251821] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.251922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.252231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.252231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.252231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.252494] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.303331] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.303331] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.303331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.303803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.303803] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be updated. [ 992.333629] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.333831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.333831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.334060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.334268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.343544] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: IN_PROGRESS for 2s [ 992.406645] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3951e5e1-7963-4597-8681-5924c72de16e: rpc.has_security_group_logging(os_id): False [ 992.411098] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.412679] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.412679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.412679] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe31c11e-3a38-45cd-a499-a846a487aa48 with status ACTIVE [ 992.412892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.412948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.412980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.413247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.413435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.413588] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.413710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.413792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.413966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.414085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.414360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.414482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.414563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.414762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.414913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.414998] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe31c11e-3a38-45cd-a499-a846a487aa48 is going to be updated. [ 992.427396] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.427557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.427600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.427801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.427889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.428087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.428185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.428281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.428441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.428520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.428709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.428796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.428859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.428994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.429126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.429258] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.429350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.429409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.429603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.429850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.429976] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 992.438332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.438570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.438693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.438884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.439069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.439242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe31c11e-3a38-45cd-a499-a846a487aa48" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.500771] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.501737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.501737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.501737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.503365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.517047] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 992.663053] env[66131]: INFO networking_nsxv3.common.synchronization [req-ae579546-d4db-46b3-9919-7b931fbe596b req-84efbb43-2716-46f0-b5b4-d35a37b90527 tempest-MultipleCreateTestJSON-198575575 tempest-MultipleCreateTestJSON-198575575-project-member] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 992.663699] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGHEST for action security_group_members [ 992.664115] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.664303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.757739] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.917391] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.264612] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.420207] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.420451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.420451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.420738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.420809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.420908] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 993.452028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.452931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.452931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.453214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.453851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.466349] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 993.567167] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efb89a8f-6be5-416d-bcac-1126e3f58519 in Status: SUCCESS [ 993.567919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.589039] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 993.589039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.647030] env[66131]: INFO networking_nsxv3.common.synchronization [None req-0f8a6846-dac3-4ef6-b05c-43e7d8f0eb0e tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 993.652790] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 993.652790] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.652790] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.652790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.652790] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.767147] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.767356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.767410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.767594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.767685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.767780] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 993.799603] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.799749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.799818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.800131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.800213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.809188] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 994.156474] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.354951] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a in Status: SUCCESS [ 994.355270] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a deletion is rescheduled due to dependency. [ 994.355348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.532351] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 994.532716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.659716] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.162575] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.162575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.162575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.162575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.162575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.162575] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 995.193586] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.193784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.193784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.193997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.194204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.211426] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 995.479075] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 995.479075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.479193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.479507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.480283] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.480283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.480283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.480283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.480579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.480579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.480579] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.821498] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 995.821739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.821934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.822631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.822631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.822631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.822836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.822881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.822971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.823083] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.983612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.983834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.983880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.984119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.984374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.984484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.984549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.984718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.984807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.984916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.985122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.985243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.985322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.985480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.985699] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.985768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.985807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.985921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.986016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.986450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.986552] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.070467] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.070467] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.070467] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.070467] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.070467] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.070467] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.071207] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.071572] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.071834] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.072194] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.072413] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.072638] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.072838] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.073084] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.073291] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.073526] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.097710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.100029] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.100029] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.100029] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.100029] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-e59a4827-5934-4699-98de-169c87aaaffa taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.100029] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.100029] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.100029] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.100029] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59a4827-5934-4699-98de-169c87aaaffa',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.326195] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.326832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.326832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.326832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.326832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.326832] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.327308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.327308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.327308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.327308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.327308] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be updated. [ 996.489196] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f85143-50cb-4ea4-b72b-837126da5251: rpc.has_security_group_logging(os_id): False [ 996.535898] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.535898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.535898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.535898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.535898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.547411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.547592] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.547708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.548023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.550260] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: IN_PROGRESS for 2s [ 996.592208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.592612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.592798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.592878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.593207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.593342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.593712] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.593947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.594063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.594460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.594603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.594933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.595111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.595246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.595550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.595669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.595756] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 996.604763] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.605124] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.605396] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.605968] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.606161] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.606336] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port e59a4827-5934-4699-98de-169c87aaaffa not found, creating... [ 996.606751] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.607023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.607172] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.607533] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.607788] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.608294] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.608524] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.608707] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.609071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.609285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.609487] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: e59a4827-5934-4699-98de-169c87aaaffa is going to be created. [ 996.670774] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.671023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.671122] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.671485] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.671796] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.672813] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.723053] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.723256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.723325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.723493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.723638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.739580] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 997.225264] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 997.225264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.407170] env[66131]: INFO networking_nsxv3.common.synchronization [req-f7d6601f-af95-4911-886c-c3067ab5ddff req-cde15a23-32d1-455b-a23e-409552a854e0 service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 997.407600] env[66131]: INFO networking_nsxv3.common.synchronization [req-f7d6601f-af95-4911-886c-c3067ab5ddff req-cde15a23-32d1-455b-a23e-409552a854e0 service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 997.407600] env[66131]: INFO networking_nsxv3.common.synchronization [req-f7d6601f-af95-4911-886c-c3067ab5ddff req-cde15a23-32d1-455b-a23e-409552a854e0 service nova] Enqueued Resource ID: e59a4827-5934-4699-98de-169c87aaaffa with Priority: HIGHEST for action port [ 997.408608] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 997.408934] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 997.409078] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e59a4827-5934-4699-98de-169c87aaaffa with Priority: HIGHEST for action port [ 997.409374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.409499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.409566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.409854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.409950] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.411385] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.411385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.411530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.411741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.411891] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.412039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.412125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.412338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.412608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.412695] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.414253] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e59a4827-5934-4699-98de-169c87aaaffa taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.414253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.414253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.414253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.414602] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59a4827-5934-4699-98de-169c87aaaffa',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.916315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.916544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.916740] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.918213] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e59a4827-5934-4699-98de-169c87aaaffa with status ACTIVE [ 997.918504] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.918708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.918779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.919026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.919779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.920099] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.920456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.920738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.921085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.921265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.921634] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.921919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.922822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.922822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.922822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.922822] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e59a4827-5934-4699-98de-169c87aaaffa is going to be updated. [ 997.949137] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.949999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.949999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.949999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.949999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.949999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e59a4827-5934-4699-98de-169c87aaaffa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.425922] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.562836] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcda49b5-8fd1-462d-976a-a25d59236231 in Status: SUCCESS [ 998.562836] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 deletion is rescheduled due to dependency. [ 998.562836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.754081] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 998.754081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.930057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.930237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.930316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.930553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.930645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.930746] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 998.970536] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.970704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.970779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.971054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.971242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.981640] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1000.705118] env[66131]: INFO networking_nsxv3.common.synchronization [req-13d76576-7fbf-475f-9621-395b916b481d req-26fd1f0f-f62e-4132-8224-b7a7b01a2bd9 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1000.705965] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1000.706383] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.706605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.706718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.707033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.707514] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.707688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.707797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.710612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.710612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.710612] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.999026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.999026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.999026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.999026] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.053456] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.053456] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.053456] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.053456] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.053809] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.053882] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.054017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.054248] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.054406] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.054617] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.054732] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.054838] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.054945] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.055064] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.055172] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.055318] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.077249] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.077516] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.077753] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.077947] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.078302] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.078581] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.078711] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.079079] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.079254] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.213190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.213384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.213452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.213697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.213811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.214062] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.214184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.214314] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.214420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.214562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.214664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e already deleted. [ 1001.214747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.501670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.501938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.502036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.502282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.502455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.502546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.502618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.502773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.502869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.502958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.503122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.503216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.503276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.503428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.503637] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.503730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.503730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.503873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.503946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.504039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.504135] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.582147] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.582406] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.582538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.582841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.583024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.583156] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 not found, creating... [ 1001.583421] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.583579] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.583694] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.583914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.585366] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.585730] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.586071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.586242] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.586556] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.586685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.586860] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 is going to be created. [ 1001.609809] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.610154] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.610337] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.610656] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.610931] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.611246] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.007250] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3951e5e1-7963-4597-8681-5924c72de16e: rpc.has_security_group_logging(os_id): False [ 1002.030623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.030825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.030869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.031084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.031179] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.031372] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.031471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.031533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.031675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.031750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.032014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.032196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.032340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.032507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.032604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.032853] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.032976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.033091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.033267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.033408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.033529] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 1002.106519] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.106741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.106785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.107019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.107172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.125834] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1002.305348] env[66131]: INFO networking_nsxv3.common.synchronization [req-13d76576-7fbf-475f-9621-395b916b481d req-5b7a7168-97e7-45a4-b6f2-e79da6ee1d75 service nova] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 1002.305566] env[66131]: INFO networking_nsxv3.common.synchronization [req-13d76576-7fbf-475f-9621-395b916b481d req-5b7a7168-97e7-45a4-b6f2-e79da6ee1d75 service nova] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1002.305718] env[66131]: INFO networking_nsxv3.common.synchronization [req-13d76576-7fbf-475f-9621-395b916b481d req-5b7a7168-97e7-45a4-b6f2-e79da6ee1d75 service nova] Enqueued Resource ID: c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 with Priority: HIGHEST for action port [ 1002.306323] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 1002.306465] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1002.306571] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 with Priority: HIGHEST for action port [ 1002.306947] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.307018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.307660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.307907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.307997] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.309992] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.309992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.309992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.310203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.310293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.312131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.312131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.312131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.312131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.312131] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.314109] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.314253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.314341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.314841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.314841] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.817569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.818196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.818533] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.819445] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 with status ACTIVE [ 1002.819653] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.820662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.820662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.820662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.820662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.820662] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.820662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.820662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.823484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.824412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.824720] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.824892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.825503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.826816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.827221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.828296] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98 is going to be updated. [ 1002.858835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.859083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.859083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.859273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.859413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.859593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3eee9b3-2515-4fd0-8e5d-e35a24f6aa98" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.332634] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.836397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.836397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.836397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.836697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.836773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.837604] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be created. [ 1003.864333] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.864506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.864567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.864777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.864939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.879375] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: UNINITIALIZED for 2s [ 1004.142815] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1004.143071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.766243] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1005.766734] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:2 started [ 1005.891198] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1005.891489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.891697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.892112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.892520] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.892674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.892762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.892958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.893088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.893135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.893280] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.123889] env[66131]: INFO networking_nsxv3.common.synchronization [req-1b437a71-3615-4540-b973-ebb3ce472329 req-d0998a90-1033-48c8-a771-8e2a1c041e8f tempest-InstanceActionsTestJSON-1165562785 tempest-InstanceActionsTestJSON-1165562785-project-member] Enqueued Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_members [ 1006.123889] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb89a8f-6be5-416d-bcac-1126e3f58519 with Priority: HIGHEST for action security_group_members [ 1006.123889] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-efb89a8f-6be5-416d-bcac-1126e3f58519 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.123889] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.123889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.124369] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efb89a8f-6be5-416d-bcac-1126e3f58519',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.396033] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.626934] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.627120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.627183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.627415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.627510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.627881] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.627881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.627881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.628090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.628131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.628214] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb89a8f-6be5-416d-bcac-1126e3f58519 is going to be updated. [ 1006.658321] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.658485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.659176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.659176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.659176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.671770] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb89a8f-6be5-416d-bcac-1126e3f58519 in Status: IN_PROGRESS for 2s [ 1006.901966] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4314113-ddb6-40ad-8c52-48dfb885822e: rpc.has_security_group_logging(os_id): False [ 1006.925025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.925025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.925025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.925025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be created. [ 1006.994735] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.994873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.994938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.995182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.995398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.005673] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1008.681827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efb89a8f-6be5-416d-bcac-1126e3f58519 in Status: SUCCESS [ 1008.682196] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efb89a8f-6be5-416d-bcac-1126e3f58519 deletion is rescheduled due to dependency. [ 1008.682196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efb89a8f-6be5-416d-bcac-1126e3f58519" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.020204] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1009.020459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.263882] env[66131]: INFO networking_nsxv3.common.synchronization [req-2583fefb-88f0-4967-a865-9ed9faf8004f req-ad6adef5-ee12-41ed-a48a-d1c8a7ff0252 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1010.264630] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1010.264981] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.265139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.265208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.265453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.265645] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.265756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.265840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.266598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.266715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.266831] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.769482] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.948973] env[66131]: INFO networking_nsxv3.common.synchronization [None req-32548a59-4d0e-48b2-9f26-f481460a6ed0 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1010.949758] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1010.950263] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.950392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.270939] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.773587] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.773836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.773836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.774054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.774146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.774297] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 1011.807686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.807843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.807917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.808143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.808287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.817461] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1012.758193] env[66131]: INFO networking_nsxv3.common.synchronization [None req-47b25d1a-2003-47b3-8e5e-8b79d60fca7d None None] Enqueued Resource ID: ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8 with Priority: HIGHEST for action port [ 1012.758193] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8 with Priority: HIGHEST for action port [ 1012.758193] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.758908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.759134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.759483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.759662] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.264455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8 [ 1013.264455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.264455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.264455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.264455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.264455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.264455] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8 already deleted. [ 1013.264455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac4eaef3-f41d-44d3-9e63-e7cd5d18f6a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.832950] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.832950] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.832950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.832950] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.969368] env[66131]: INFO networking_nsxv3.common.synchronization [req-7e3d8250-578a-400b-9449-8484d52dc65a req-b9f53007-df12-47be-a896-a2096f2771d5 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_members [ 1013.969909] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGHEST for action security_group_members [ 1013.970227] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.970352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.970419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.970610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.970840] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.971253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.971253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.971253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.971253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.971429] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.097024] env[66131]: INFO networking_nsxv3.common.synchronization [None req-cb5105a9-ca1d-4299-89b6-959b8c531a0d tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_rules [ 1014.097731] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_rules [ 1014.098554] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.098554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.098554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.098724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.098823] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.212181] env[66131]: INFO networking_nsxv3.common.synchronization [None req-39c2b975-0cdf-443e-b6f8-e637a4bc1bef tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_rules [ 1014.212181] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_rules [ 1014.212181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.212181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.336338] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.336510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.336658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.336869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.336964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.337174] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.337271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.337333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.337476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.337550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.337632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 1014.370077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.370246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.370246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.370441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.370669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.381217] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1014.473763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.473939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.473939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.474175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.474238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.474456] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.474562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.474626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.474794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.474869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.474956] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 is going to be updated. [ 1014.505305] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.505305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.505305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.505305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.505591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.515898] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 in Status: IN_PROGRESS for 2s [ 1014.622129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.622283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.622369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.622604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.622699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.622783] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f already deleted. [ 1014.622857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.623016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.623331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.623418] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.715691] env[66131]: INFO networking_nsxv3.common.synchronization [req-4e1ce79d-626c-40aa-a434-0177518f37bf req-20df67dc-d033-4419-8f20-29810d17a936 tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_members [ 1014.719052] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_members [ 1014.719052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.719052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.719052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.719052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.719907] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.719907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.719907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.720041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.720106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.720208] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.149698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.150042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.150042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.150150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.150220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.150443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f already deleted. [ 1015.150443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.168512] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.168712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.168834] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.169130] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.169390] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.169671] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.169671] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.169899] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.170053] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.170261] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.170371] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.170479] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.170588] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.170696] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.170797] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.170922] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.194931] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.194931] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.194931] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.194931] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-749" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.195250] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-a35246db-38da-4073-95a3-96ef794806d0 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.195250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.195655] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.195655] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.195794] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a35246db-38da-4073-95a3-96ef794806d0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.222175] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.222474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.222534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.222728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.222834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.223045] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.223149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.223211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.223362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.223439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.223523] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 already deleted. [ 1015.223602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.270217] env[66131]: INFO networking_nsxv3.common.synchronization [None req-fd58f8ff-3b52-4f7e-a607-12c19fb8a0cc None None] Enqueued Resource ID: 9b7557a0-429d-43f7-a4cd-7fcfc4cff631 with Priority: HIGHEST for action port [ 1015.273038] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7557a0-429d-43f7-a4cd-7fcfc4cff631 with Priority: HIGHEST for action port [ 1015.273038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7557a0-429d-43f7-a4cd-7fcfc4cff631 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.273038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7557a0-429d-43f7-a4cd-7fcfc4cff631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.273038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7557a0-429d-43f7-a4cd-7fcfc4cff631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.273038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7557a0-429d-43f7-a4cd-7fcfc4cff631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.273038] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7557a0-429d-43f7-a4cd-7fcfc4cff631',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.698580] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.699092] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.699092] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.699346] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.699540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.699992] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port a35246db-38da-4073-95a3-96ef794806d0 not found, creating... [ 1015.700096] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.700235] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.700370] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.700624] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.700776] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.701108] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.701292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.701417] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.701627] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.701763] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.701901] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: a35246db-38da-4073-95a3-96ef794806d0 is going to be created. [ 1015.721625] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.721815] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.721937] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.722241] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.722579] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.722805] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.775061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b7557a0-429d-43f7-a4cd-7fcfc4cff631 [ 1015.775387] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.775514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.775604] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.775778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.775867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.775961] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b7557a0-429d-43f7-a4cd-7fcfc4cff631 already deleted. [ 1015.776057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7557a0-429d-43f7-a4cd-7fcfc4cff631" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.391225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1016.391643] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e deletion is rescheduled due to dependency. [ 1016.391643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.454640] env[66131]: INFO networking_nsxv3.common.synchronization [req-4e1ce79d-626c-40aa-a434-0177518f37bf req-f68b1a35-bc95-447d-806a-1b3dd4bdbf0e service nova] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_rules [ 1016.454811] env[66131]: INFO networking_nsxv3.common.synchronization [req-4e1ce79d-626c-40aa-a434-0177518f37bf req-f68b1a35-bc95-447d-806a-1b3dd4bdbf0e service nova] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_members [ 1016.454947] env[66131]: INFO networking_nsxv3.common.synchronization [req-4e1ce79d-626c-40aa-a434-0177518f37bf req-f68b1a35-bc95-447d-806a-1b3dd4bdbf0e service nova] Enqueued Resource ID: a35246db-38da-4073-95a3-96ef794806d0 with Priority: HIGHEST for action port [ 1016.455522] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_rules [ 1016.455720] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_members [ 1016.455768] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a35246db-38da-4073-95a3-96ef794806d0 with Priority: HIGHEST for action port [ 1016.456013] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.457245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.457245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.457950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.457950] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.462071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.462258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.462258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.462454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.462615] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.463197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.463277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.463427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.463511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.463607] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.466888] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a35246db-38da-4073-95a3-96ef794806d0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.466888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.467338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.467338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.467338] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a35246db-38da-4073-95a3-96ef794806d0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.525865] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 in Status: SUCCESS [ 1016.526105] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 deletion is rescheduled due to dependency. [ 1016.526215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.772324] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2863e3df-31f5-4d9c-84b4-2839e95ed24e None None] Enqueued Resource ID: c420ba3c-e684-4748-8271-7bad38dd58c1 with Priority: HIGHEST for action port [ 1016.773046] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c420ba3c-e684-4748-8271-7bad38dd58c1 with Priority: HIGHEST for action port [ 1016.773858] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c420ba3c-e684-4748-8271-7bad38dd58c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.773962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c420ba3c-e684-4748-8271-7bad38dd58c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.774023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c420ba3c-e684-4748-8271-7bad38dd58c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.774261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c420ba3c-e684-4748-8271-7bad38dd58c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.774333] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c420ba3c-e684-4748-8271-7bad38dd58c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.969006] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.970185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.970316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.970447] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a35246db-38da-4073-95a3-96ef794806d0 with status ACTIVE [ 1016.970655] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.970753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.970753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.970962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.971064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.971232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.971345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.971414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.971591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.971673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.971854] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.971963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.971995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.972813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.972900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.972988] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a35246db-38da-4073-95a3-96ef794806d0 is going to be updated. [ 1016.997346] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.997507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.997587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.998188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.998188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.998188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a35246db-38da-4073-95a3-96ef794806d0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.277182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c420ba3c-e684-4748-8271-7bad38dd58c1 [ 1017.277182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.277182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.277182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.277182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.277182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.277182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c420ba3c-e684-4748-8271-7bad38dd58c1 already deleted. [ 1017.277182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c420ba3c-e684-4748-8271-7bad38dd58c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.475907] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.979216] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.979216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.979216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.981550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.981550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.981550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 is going to be created. [ 1018.006775] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.006970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.007080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.007311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.007506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.018337] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: UNINITIALIZED for 2s [ 1019.300726] env[66131]: INFO networking_nsxv3.common.synchronization [None req-58b798b9-7c37-4ee3-bd10-609b2638a089 None None] Enqueued Resource ID: 2319baf1-bf76-475e-baa5-0ee15b06ebaa with Priority: HIGHEST for action port [ 1019.301290] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2319baf1-bf76-475e-baa5-0ee15b06ebaa with Priority: HIGHEST for action port [ 1019.301604] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2319baf1-bf76-475e-baa5-0ee15b06ebaa taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.301726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2319baf1-bf76-475e-baa5-0ee15b06ebaa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.301796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2319baf1-bf76-475e-baa5-0ee15b06ebaa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.303136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2319baf1-bf76-475e-baa5-0ee15b06ebaa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.303256] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2319baf1-bf76-475e-baa5-0ee15b06ebaa',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.410430] env[66131]: INFO networking_nsxv3.common.synchronization [req-b49b427d-365d-41cf-bee6-bca1c8e226c5 req-9c3d5c21-79a9-4a89-93e7-21dddcf70d18 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1019.410979] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1019.411742] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.412094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.412167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.412364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.412527] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.412637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.412690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.412839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.412926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.413030] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.785569] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.785861] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.786011] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.786279] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.786558] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.786754] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.786897] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.787348] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.787438] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.787687] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.787845] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.787993] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.788224] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.788425] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.788579] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.788752] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.805699] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2319baf1-bf76-475e-baa5-0ee15b06ebaa [ 1019.805978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.806155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.806240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.806469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.806564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.806707] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2319baf1-bf76-475e-baa5-0ee15b06ebaa already deleted. [ 1019.806845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2319baf1-bf76-475e-baa5-0ee15b06ebaa" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.808211] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.808743] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.808743] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.808743] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.808964] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.809110] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.809272] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.809565] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.809708] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c25faa3-96da-4e6a-ad65-19ccf574fdcd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.915783] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.915955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.916092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.916324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.916421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.916623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.916723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.916785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.916940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.917026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.917115] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1019.942036] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.942204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.942204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.942353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.942527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.950949] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1020.028711] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: SUCCESS [ 1020.028998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.029233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.029501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.029708] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.029824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.029890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.030062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.030128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.030210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.030304] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.312516] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.312858] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.312904] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.313531] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.313531] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.313627] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 8c25faa3-96da-4e6a-ad65-19ccf574fdcd not found, creating... [ 1020.313922] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.314141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.314288] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.314618] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.314802] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.315141] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.315382] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.315524] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.315697] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.315831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.315973] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 8c25faa3-96da-4e6a-ad65-19ccf574fdcd is going to be created. [ 1020.337977] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.338185] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.338308] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.338683] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.338956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.339237] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.534425] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.037377] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e5ff25-a7e6-4827-af48-1a633ae5e029: rpc.has_security_group_logging(os_id): False [ 1021.054912] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.055064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.055134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.055357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.056229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.056229] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.056229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.056229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.059716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.059716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.059716] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 is going to be created. [ 1021.066033] env[66131]: INFO networking_nsxv3.common.synchronization [req-b49b427d-365d-41cf-bee6-bca1c8e226c5 req-c188e6b5-3336-4687-9bca-0c4014a5f9a6 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1021.066033] env[66131]: INFO networking_nsxv3.common.synchronization [req-b49b427d-365d-41cf-bee6-bca1c8e226c5 req-c188e6b5-3336-4687-9bca-0c4014a5f9a6 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1021.066033] env[66131]: INFO networking_nsxv3.common.synchronization [req-b49b427d-365d-41cf-bee6-bca1c8e226c5 req-c188e6b5-3336-4687-9bca-0c4014a5f9a6 service nova] Enqueued Resource ID: 8c25faa3-96da-4e6a-ad65-19ccf574fdcd with Priority: HIGHEST for action port [ 1021.066033] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1021.066033] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1021.066033] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c25faa3-96da-4e6a-ad65-19ccf574fdcd with Priority: HIGHEST for action port [ 1021.066033] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.066033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.066033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.067107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.067445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.070133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.070250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.070770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.070934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.070994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.071292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.071292] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c25faa3-96da-4e6a-ad65-19ccf574fdcd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.119248] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.119393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.119441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.119625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.119809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.130640] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: IN_PROGRESS for 2s [ 1021.573069] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.573069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.573527] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c25faa3-96da-4e6a-ad65-19ccf574fdcd with status ACTIVE [ 1021.573527] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.573527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.573527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.573668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.573726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.573891] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.574027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.574061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.574220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.574266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.574468] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.574550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.574609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.574762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.574803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.574886] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c25faa3-96da-4e6a-ad65-19ccf574fdcd is going to be updated. [ 1021.598728] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.598894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.598958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.599183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.599524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.599704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c25faa3-96da-4e6a-ad65-19ccf574fdcd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.848330] env[66131]: INFO networking_nsxv3.common.synchronization [req-83241535-9a12-49bd-9352-4d18fc2c226f req-1bccfd27-11b2-4968-99d7-3c53e7a2e5e5 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1021.848921] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1021.849250] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.849381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.849446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.849783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.849954] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.850067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.850126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.850278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.850364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.850456] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.963350] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1021.963572] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1021.963642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.963871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.964101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.964306] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.964423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.964519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.964699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.964803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.964903] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.160595] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.160790] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.160866] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.161559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.161559] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.161559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.161771] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.161810] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.161927] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.162142] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.162254] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.162380] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.162517] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.162628] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.162748] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.162853] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.182864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.183071] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.183215] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.183410] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.183737] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-27ebece6-c9ce-400a-924d-f8a50406a3eb taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.183914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.184042] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.184364] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.184519] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27ebece6-c9ce-400a-924d-f8a50406a3eb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.353046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.353225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.353299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.353518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.353622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.353812] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.353906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.353964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.354124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.354199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.354280] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff already deleted. [ 1022.354359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.467945] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.687512] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.687939] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.688179] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.688647] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.688926] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.689246] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 27ebece6-c9ce-400a-924d-f8a50406a3eb not found, creating... [ 1022.689704] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.690017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.690229] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.690631] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.690922] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.691459] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.691762] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.692012] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.692471] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.692738] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.692994] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 27ebece6-c9ce-400a-924d-f8a50406a3eb is going to be created. [ 1022.715613] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.716056] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.716833] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.717290] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.717671] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.718054] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.969861] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.143709] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: SUCCESS [ 1023.143926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.407474] env[66131]: INFO networking_nsxv3.common.synchronization [req-83241535-9a12-49bd-9352-4d18fc2c226f req-a437529c-7a8c-429a-ba18-501427362c56 service nova] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_rules [ 1023.407474] env[66131]: INFO networking_nsxv3.common.synchronization [req-83241535-9a12-49bd-9352-4d18fc2c226f req-a437529c-7a8c-429a-ba18-501427362c56 service nova] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1023.407474] env[66131]: INFO networking_nsxv3.common.synchronization [req-83241535-9a12-49bd-9352-4d18fc2c226f req-a437529c-7a8c-429a-ba18-501427362c56 service nova] Enqueued Resource ID: 27ebece6-c9ce-400a-924d-f8a50406a3eb with Priority: HIGHEST for action port [ 1023.407474] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_rules [ 1023.407474] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1023.407474] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ebece6-c9ce-400a-924d-f8a50406a3eb with Priority: HIGHEST for action port [ 1023.407474] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.410650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.410944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.411480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.412049] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.413374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.413699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.413908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.414221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.414517] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.418021] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.418021] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-27ebece6-c9ce-400a-924d-f8a50406a3eb taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.418021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.418021] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27ebece6-c9ce-400a-924d-f8a50406a3eb',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.471997] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.472170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.472240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.472512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.472610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.472710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1023.503922] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.504192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.504266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.504526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.504674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.517432] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1023.918797] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.919120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.919164] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.920086] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27ebece6-c9ce-400a-924d-f8a50406a3eb with status ACTIVE [ 1023.920747] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.920747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.920747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.920747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.920747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.921074] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.921074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.921074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.921200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.921264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.921441] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.922037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.922037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.922037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.922037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.922037] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27ebece6-c9ce-400a-924d-f8a50406a3eb is going to be updated. [ 1023.946631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.946631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.946631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.946891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.946926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.947151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27ebece6-c9ce-400a-924d-f8a50406a3eb" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.276826] env[66131]: INFO networking_nsxv3.common.synchronization [req-82505e01-761e-4461-940e-ab4ca905a259 req-f054890b-18b0-42c5-ad6b-ef95f3ed7857 tempest-ServersNegativeTestJSON-775626346 tempest-ServersNegativeTestJSON-775626346-project-member] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 1024.277525] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGHEST for action security_group_members [ 1024.277980] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.278119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.278119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.278319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.278471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.278570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.278630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.278908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.278970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.279022] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.423601] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.781125] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.781325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.781325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.781518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.781611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781976] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.782104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.782151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.782317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.782579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.782667] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be updated. [ 1024.817533] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.817774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.817875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.818163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.819034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.828028] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: IN_PROGRESS for 2s [ 1024.929038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.929413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.929413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.929487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.929556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.929714] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be created. [ 1024.954996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.955211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.955211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.955888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.955888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.966861] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: UNINITIALIZED for 2s [ 1025.527484] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1025.527732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.527898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.528129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.528323] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.528467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.528541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.528709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.528832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.528940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.529049] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.033360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.033360] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.033360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.034087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.034087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.034087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.034087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.034087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.034257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.034289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.034451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.034632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.034707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.034832] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.537632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95303b6-7e26-444d-bfa3-5518dbc80e21: rpc.has_security_group_logging(os_id): False [ 1026.558669] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.558862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.558970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.559153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.559254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.559447] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.559546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.559608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.559798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.559914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.560122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.560218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.560279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.560419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.560496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.560705] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.560799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.560902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.560995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.561083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.561169] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1026.624698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.624858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.624926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.625148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.625550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.637323] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1026.838792] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f85143-50cb-4ea4-b72b-837126da5251 in Status: SUCCESS [ 1026.839116] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 deletion is rescheduled due to dependency. [ 1026.839116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.978848] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1026.979046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.979217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.979439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.979728] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.979728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.979909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.979992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.980065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.980123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.980312] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.482693] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.483194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.483194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.483194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.483477] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.483477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.483713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.483713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.483808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.483849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.483996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.484083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.484128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.484303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.484400] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.484489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.484564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.484725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.484814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.484912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.484981] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.988784] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b136f51b-9f69-44ec-b06b-d90265f6efff: rpc.has_security_group_logging(os_id): False [ 1028.014626] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.014806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.014871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.015106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.015196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.015412] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.015595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.015669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.015825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.015904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.016117] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.016213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.016267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.016407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.016480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.016686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.016772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.016870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.017031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.017107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.017195] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be created. [ 1028.092840] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.093089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.093159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.093388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.093627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.106948] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: IN_PROGRESS for 2s [ 1028.255962] env[66131]: INFO networking_nsxv3.common.synchronization [None req-76d35ee8-8522-492c-a765-fb1e8b87b8e6 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1028.256536] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1028.256860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.257037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.257113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.257385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.257471] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.357027] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6f151410-b4f1-4689-ae3f-dad1f20e2a4c tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1028.357611] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1028.357746] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.357838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.651689] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1028.651689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.779464] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.779619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.779669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.779953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.780082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.780204] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 already deleted. [ 1028.780622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.780622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.780622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.780850] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.303625] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.303625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.303625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.303625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.303625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.303625] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 already deleted. [ 1029.303625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.315020] env[66131]: INFO networking_nsxv3.common.synchronization [req-80003cb0-2b28-439d-b32b-d23d410717b4 req-40e6fe35-e7dd-4cec-9b57-493afae2c461 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1029.315020] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1029.315020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.315020] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.315020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.316923] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.819617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.819912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.819912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.820086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.820183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.820378] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.820480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.820541] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.820696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.820765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.820847] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 1029.850924] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.851174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.851174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.851347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.851491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.860102] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 1030.120187] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1030.120479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.410994] env[66131]: INFO networking_nsxv3.common.synchronization [req-e7b5f0f5-2867-4e6b-ae74-173f6558de10 req-3800b6af-e077-4b98-a217-db3948890af0 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_members [ 1030.411603] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_members [ 1030.411953] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.412109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.412191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.412383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.412574] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.412703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.412782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.412949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.413038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.413128] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.773124] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-402 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.773330] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.773452] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.773791] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.774090] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.774274] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.774390] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.774644] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.774786] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.774990] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.775283] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.775401] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.775516] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.775668] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.775789] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.775917] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.794654] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.794934] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.795155] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.795341] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.795653] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-ba59345f-64f1-46fe-85e8-d507690401b1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.795826] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.795974] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.796301] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.796506] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba59345f-64f1-46fe-85e8-d507690401b1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.916327] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.916731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.916731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.916811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.916868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.917092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.917198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.917313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.917473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.917550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.917632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f already deleted. [ 1030.917755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.298699] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.298965] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.299061] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.299336] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.299483] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.299675] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port ba59345f-64f1-46fe-85e8-d507690401b1 not found, creating... [ 1031.299959] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.300141] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.300257] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.300474] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.300609] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.300928] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.301136] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.301257] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.301465] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.301599] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.301745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: ba59345f-64f1-46fe-85e8-d507690401b1 is going to be created. [ 1031.339370] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.339650] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.339822] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.340135] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.340373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.340598] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.872118] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 1031.872285] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 1031.872438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.030734] env[66131]: INFO networking_nsxv3.common.synchronization [req-e7b5f0f5-2867-4e6b-ae74-173f6558de10 req-c059a9b0-6eaa-4263-89e2-08c87e92d129 service nova] Enqueued Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_rules [ 1032.031015] env[66131]: INFO networking_nsxv3.common.synchronization [req-e7b5f0f5-2867-4e6b-ae74-173f6558de10 req-c059a9b0-6eaa-4263-89e2-08c87e92d129 service nova] Enqueued Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_members [ 1032.031127] env[66131]: INFO networking_nsxv3.common.synchronization [req-e7b5f0f5-2867-4e6b-ae74-173f6558de10 req-c059a9b0-6eaa-4263-89e2-08c87e92d129 service nova] Enqueued Resource ID: ba59345f-64f1-46fe-85e8-d507690401b1 with Priority: HIGHEST for action port [ 1032.031590] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_rules [ 1032.031756] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_members [ 1032.031869] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba59345f-64f1-46fe-85e8-d507690401b1 with Priority: HIGHEST for action port [ 1032.032452] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.032726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.032828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.033418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.033504] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.035158] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.035276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.035354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.035565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.035892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.036494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.036595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.036778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.036872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.037080] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.038153] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba59345f-64f1-46fe-85e8-d507690401b1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.038270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.038377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.038611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.039663] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba59345f-64f1-46fe-85e8-d507690401b1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.541579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.541770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.541985] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.543132] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba59345f-64f1-46fe-85e8-d507690401b1 with status ACTIVE [ 1032.543323] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.543449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.543520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.543734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.543820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.544012] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.544101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.544175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.544322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.544452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.544665] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.544791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.544855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.545014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.545234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.545356] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba59345f-64f1-46fe-85e8-d507690401b1 is going to be updated. [ 1032.568575] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.568803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.568803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.569152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.569335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.569549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba59345f-64f1-46fe-85e8-d507690401b1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.047438] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.550244] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.550459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.550521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.550753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.550833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.550935] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f is going to be created. [ 1033.577492] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.577723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.577723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.577919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.578104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.588271] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f in Status: UNINITIALIZED for 2s [ 1035.600732] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f in Status: SUCCESS [ 1035.601140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.601307] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.601599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.601868] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.602096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.602216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.602434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.602575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.602753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.602916] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.107587] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.610560] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5ce0271-b593-4da3-ae20-ecdb3d31bc3f: rpc.has_security_group_logging(os_id): False [ 1036.636861] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.637063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.637709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.637709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.637709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.637709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.638019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.638019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.638086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.638197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.638241] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f is going to be created. [ 1036.709138] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.709138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.709138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.709138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.709346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.712941] env[66131]: INFO networking_nsxv3.common.synchronization [req-a2a44636-f2d8-49d5-90bc-7e0a1933127c req-7768d1ff-33fc-449e-981f-e560ebb25fad tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1036.713553] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1036.713911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.717063] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.717063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.717063] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.723050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f in Status: IN_PROGRESS for 2s [ 1037.110438] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.110714] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.110863] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.111200] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.111506] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.111724] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.111851] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.112118] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.112281] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.112521] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.112639] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.112776] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.112906] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.113265] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.113265] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.113265] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.133084] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.133294] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.133406] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.133590] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.133984] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-b0493177-b9ed-4509-999b-3399453bfee9 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.134209] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.134368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.134742] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.134893] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0493177-b9ed-4509-999b-3399453bfee9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.217911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.218092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.218092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.218323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.218452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.218692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.218901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.219053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.219281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.219395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.219488] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d already deleted. [ 1037.219573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.638274] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.638696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.638883] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.639327] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.639547] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.639817] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port b0493177-b9ed-4509-999b-3399453bfee9 not found, creating... [ 1037.640769] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.641071] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.641299] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.641662] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.641940] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.642487] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.642647] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.642818] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.643178] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.643443] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.643693] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: b0493177-b9ed-4509-999b-3399453bfee9 is going to be created. [ 1037.675180] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.675396] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.675525] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.675843] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.676106] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.676348] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.396249] env[66131]: INFO networking_nsxv3.common.synchronization [req-a2a44636-f2d8-49d5-90bc-7e0a1933127c req-363d850f-951a-4fb4-915e-434dc2302aed service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1038.396435] env[66131]: INFO networking_nsxv3.common.synchronization [req-a2a44636-f2d8-49d5-90bc-7e0a1933127c req-363d850f-951a-4fb4-915e-434dc2302aed service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1038.396573] env[66131]: INFO networking_nsxv3.common.synchronization [req-a2a44636-f2d8-49d5-90bc-7e0a1933127c req-363d850f-951a-4fb4-915e-434dc2302aed service nova] Enqueued Resource ID: b0493177-b9ed-4509-999b-3399453bfee9 with Priority: HIGHEST for action port [ 1038.397108] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1038.397248] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1038.397344] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0493177-b9ed-4509-999b-3399453bfee9 with Priority: HIGHEST for action port [ 1038.397610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.397731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.397795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.399157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.399157] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.401034] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.401195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.401267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.401489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.401664] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.401766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.401869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.401976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.402076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.402168] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.408017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0493177-b9ed-4509-999b-3399453bfee9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.408017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.408017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.408017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.408017] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0493177-b9ed-4509-999b-3399453bfee9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.736444] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f in Status: SUCCESS [ 1038.737251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.909378] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.910401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.910535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.911135] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0493177-b9ed-4509-999b-3399453bfee9 with status ACTIVE [ 1038.911135] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.911135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.911135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.911380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.911380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.911472] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.911521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.911555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.912542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.912542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.912542] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.912542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.912542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.912542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.912542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.912542] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0493177-b9ed-4509-999b-3399453bfee9 is going to be updated. [ 1038.938786] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.938991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.938991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.939220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.939360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.939514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0493177-b9ed-4509-999b-3399453bfee9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.068262] env[66131]: INFO networking_nsxv3.common.synchronization [req-dded35b8-883e-490e-ac41-3ac5ae76d691 req-a376d415-9021-4b7f-8ec9-8e905b7886d1 tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1039.068706] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1039.069061] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.069159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.069218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.069457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.069615] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.069715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.069770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.069972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.070076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.070172] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.414245] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.429372] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.429653] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.429910] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.430324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.430645] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.430834] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.430957] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.431207] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.431413] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.431664] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.431799] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.431875] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.432017] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.432140] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.432345] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.432423] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.466268] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.466522] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.466791] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.467077] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-429" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.467529] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.467936] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.468195] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.468722] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.469115] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('814cd4b5-5e4d-4b69-a5ac-bc790ddfac97',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.573714] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.573714] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.573714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.573714] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 1039.607298] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.607591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.607591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.607819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.607963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.619833] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 1039.920274] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.920274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.920274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.920274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.920274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.920274] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be created. [ 1039.944071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.944250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.944250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.944519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.945658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.957877] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: UNINITIALIZED for 2s [ 1039.976714] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.976930] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.977091] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.977505] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.977682] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.977682] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 not found, creating... [ 1039.978405] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.978405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.978405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.978405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.978612] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.978828] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.978981] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.979154] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.979389] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.979468] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.979581] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 is going to be created. [ 1040.003284] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.003446] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.003572] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.003844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.004093] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.004344] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.738806] env[66131]: INFO networking_nsxv3.common.synchronization [req-dded35b8-883e-490e-ac41-3ac5ae76d691 req-8c4e1107-29b4-4600-bb71-4cc47c6d00a0 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 1040.739017] env[66131]: INFO networking_nsxv3.common.synchronization [req-dded35b8-883e-490e-ac41-3ac5ae76d691 req-8c4e1107-29b4-4600-bb71-4cc47c6d00a0 service nova] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1040.739175] env[66131]: INFO networking_nsxv3.common.synchronization [req-dded35b8-883e-490e-ac41-3ac5ae76d691 req-8c4e1107-29b4-4600-bb71-4cc47c6d00a0 service nova] Enqueued Resource ID: 814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 with Priority: HIGHEST for action port [ 1040.739777] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_rules [ 1040.739913] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1040.740035] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 with Priority: HIGHEST for action port [ 1040.740319] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.740481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.740551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.741389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.741487] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.745552] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.745552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.745552] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.745552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.745552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.745552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.745552] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('814cd4b5-5e4d-4b69-a5ac-bc790ddfac97',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.243512] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.243889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.247821] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 with status ACTIVE [ 1041.248075] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.248210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.248280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.248487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.248601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.248774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.248865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.248981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.249199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.249319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.249526] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.249625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.249682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.249822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.249896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.250032] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 814cd4b5-5e4d-4b69-a5ac-bc790ddfac97 is going to be updated. [ 1041.273150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.273308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.273440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.273583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.275049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.275254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-814cd4b5-5e4d-4b69-a5ac-bc790ddfac97" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.520720] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c1f010e-da03-4738-9433-6f32a52f0d71 req-0a258125-28e4-4a64-8d7b-808334866486 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1041.521918] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1041.521918] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.521918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.521918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.522333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.522561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.522664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.522852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.523063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.523158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.523311] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.631432] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 1041.632233] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 1041.632233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.632233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.632233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.632854] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.632854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.632854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.632854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.633077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.633077] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.936200] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.936956] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.937179] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.937565] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.937990] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.938349] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.938522] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.938819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.939016] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.939262] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.939382] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.939537] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.939669] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.939821] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.939958] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.940143] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.963724] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.963903] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.964091] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.966137] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.966137] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.966137] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.966137] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.966137] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.966137] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002f9fd1-c496-4e0b-baf7-fb17629eb8a3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.969986] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1041.970320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.970495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.973543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.973543] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.973543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.973543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.973543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.973543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.973543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.973543] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.025941] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.026145] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.026269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.026450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.026533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.026746] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.026846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.026909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.027181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.027269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.027357] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 already deleted. [ 1042.027440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.136276] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.468520] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.468835] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.468996] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.469425] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.469790] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.469790] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 002f9fd1-c496-4e0b-baf7-fb17629eb8a3 not found, creating... [ 1042.470077] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.470265] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.470399] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.470675] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.470879] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.471236] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.471436] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.471702] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.471928] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.472082] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.472228] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 002f9fd1-c496-4e0b-baf7-fb17629eb8a3 is going to be created. [ 1042.476557] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.476637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.476637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.476828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.476979] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.477107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.477173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.477331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.477412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.477490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.477633] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.477721] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.477799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.477943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.478097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.478197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.478517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.478517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.478517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.478517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.478804] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.503653] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.503826] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.503966] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.504438] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.504880] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.505241] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.639718] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.722848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.722848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.722848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.722848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.722848] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.985189] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1043.010150] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.010378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.010438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.011607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.011607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.011607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.011607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.011607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.012087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.012087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.012194] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.012350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.012441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.012705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.012836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.013137] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.013269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.013367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.013536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.013643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.013773] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be created. [ 1043.114230] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.114445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.114540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.117728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.117728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.131288] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1043.141935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.142115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.142265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.142489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.142617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.142814] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 1043.180332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.180574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.181291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.181291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.181291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.192264] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 1043.224912] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.291510] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c1f010e-da03-4738-9433-6f32a52f0d71 req-ee4aec69-c5e2-4ea7-94cd-b324bf9560ca service nova] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1043.291688] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c1f010e-da03-4738-9433-6f32a52f0d71 req-ee4aec69-c5e2-4ea7-94cd-b324bf9560ca service nova] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1043.291832] env[66131]: INFO networking_nsxv3.common.synchronization [req-1c1f010e-da03-4738-9433-6f32a52f0d71 req-ee4aec69-c5e2-4ea7-94cd-b324bf9560ca service nova] Enqueued Resource ID: 002f9fd1-c496-4e0b-baf7-fb17629eb8a3 with Priority: HIGHEST for action port [ 1043.292349] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1043.292491] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1043.292598] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002f9fd1-c496-4e0b-baf7-fb17629eb8a3 with Priority: HIGHEST for action port [ 1043.292899] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.293047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.293089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.293290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.293377] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.295077] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.295077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.295077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.295254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.295407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.296435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.296435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.296435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.296435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.296435] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.297315] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.297479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.297525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.298028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.298028] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002f9fd1-c496-4e0b-baf7-fb17629eb8a3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.727355] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.796057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.796238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.797510] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.800300] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 002f9fd1-c496-4e0b-baf7-fb17629eb8a3 with status ACTIVE [ 1043.800432] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.800555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.800622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.800872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.801034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.801246] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.801353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.801416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.801591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.801670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.801850] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.801945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.801997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.802153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.802226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.802310] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 002f9fd1-c496-4e0b-baf7-fb17629eb8a3 is going to be updated. [ 1043.823622] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.823823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.824366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.824597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.824786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.824985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-002f9fd1-c496-4e0b-baf7-fb17629eb8a3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.229462] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1044.229622] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1044.299849] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.802747] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.803077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.803190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.803400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.803511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.803603] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be created. [ 1044.833610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.833904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.833904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.834202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.834408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.845424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: UNINITIALIZED for 2s [ 1045.141740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.141740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.141740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.141740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.157389] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1045.158473] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.159833] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1045.161656] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1045.161921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.204227] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 1045.204517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.204709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.205033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.205507] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.205507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.205507] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.205692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.205692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.205794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.205840] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.208820] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.208992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.209054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.209454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.221280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.222019] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1045.222207] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1045.222207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1045.275679] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.276016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.276094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.276427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.278606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.278931] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1045.445848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.445848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.445848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.446203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.446484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.446838] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1045.543771] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.544054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.544158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.544742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.544946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.545412] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1045.545549] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cd68ac80-456d-40a6-bada-de320b838ff6', 'c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62', '6e016bdc-1186-4d65-a6a4-b589ea567689', 'fc4e8c15-6df2-42fb-824c-bb556c5b499a', '3951e5e1-7963-4597-8681-5924c72de16e', '2d77f610-439c-48b3-8ae3-c867ae6ba8f2', '30740e8f-2016-47cb-9949-af7efd303581', '9664a1c4-6b34-480a-af3f-b95cb52e088f', '40da76d9-e82a-4df1-a543-dfbd1d154789', 'd6f876b0-0618-417d-b11e-0e430c4a1630', 'd95303b6-7e26-444d-bfa3-5518dbc80e21', 'e4314113-ddb6-40ad-8c52-48dfb885822e', 'acdbc051-fd26-4fc2-8ede-29b7d3e743af', 'e0d36cff-f4fc-446d-99f9-4c5d0aad46f4', '46e5ff25-a7e6-4827-af48-1a633ae5e029', 'a68adb37-f05f-44c4-a13b-7eb7bc0ab766', '66976a1f-1587-4537-a4a6-12265096339d', 'ad174bf4-cd31-47d0-b677-2a143083800a', 'bcda49b5-8fd1-462d-976a-a25d59236231', 'ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207', '69f85143-50cb-4ea4-b72b-837126da5251', '6518e255-8a48-4fe6-8c80-b478b31e143a', '0f3bfadc-ee4e-4dd7-a668-86025968cc1f', '87932d1b-2e10-4f4e-b38c-90b3b495ce14', '395c7bb1-0365-458d-a01e-64a431cc84a0', 'eef72789-9405-4544-841f-1905c2771a0d', '2d46ac8a-ba3b-4036-8bf0-647896954581', '8c5da787-634a-44a5-9a16-ff46306549cf', 'ef5c2151-bad2-47ce-a462-d37d0b06e5f6', 'd18d1e64-ca33-4d89-b4cf-d9d209fdd092', '88c2f217-48ed-4b9b-b2f8-5e8fec9e586d', 'a7fc9052-f286-4d53-8d9d-b976649d992e', '1c204a4b-a669-4fe4-b5e6-edacdb0d1270', '091418bc-6d4e-4be2-bfdc-783bb4e9e92b', '019f05d6-48e0-4ee7-bcb4-af4a1a2925af', '3affe7d0-eaa2-49d5-be04-f70f6d573297', 'f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a', 'efb89a8f-6be5-416d-bcac-1126e3f58519', '4320e0f3-4bbc-42b2-999c-7e766e099226', '3724e928-c7a7-4c1d-a230-ec565cc9eb94', 'b136f51b-9f69-44ec-b06b-d90265f6efff', '54bcb296-38dd-4765-9095-b0ead7c5de56', '635d180a-1a27-4897-8f2c-a14eca9102c1', 'c5ce0271-b593-4da3-ae20-ecdb3d31bc3f'} {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1045.545706] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1045.572778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.573067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.573148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.573363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.573474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.573598] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1045.573676] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1045.573754] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1045.635857] env[66131]: INFO networking_nsxv3.common.synchronization [req-12d67cfc-e3ed-4634-b74d-b114b4af8651 req-596f99f1-378f-4ba0-ad56-56bf4bd992e7 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1045.636459] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1045.637041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.637041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.637041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.637238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.637271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.637370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.637410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.637547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.637628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.637714] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.650760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.650913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.650979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.651513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.652572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.652943] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1045.652943] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1045.653025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1045.653823] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1045.653823] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGH for action security_group_rules [ 1045.653823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGH for action security_group_rules [ 1045.654325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGH for action security_group_rules [ 1045.654536] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGH for action security_group_rules [ 1045.654536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.724405] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.724914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.724914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.725053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.725260] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.725385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.725450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.725628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.725717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.725855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.725990] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.726101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.726162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.726318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.726455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.726546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.726605] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.726799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.726955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.727055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.727147] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.142135] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.142135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.142135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.142612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.167319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.167694] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.167901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.168075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.168622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.168622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.168839] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1046.197880] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.198146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.198146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.198311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.198450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.207434] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1046.229071] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6518e255-8a48-4fe6-8c80-b478b31e143a: rpc.has_security_group_logging(os_id): False [ 1046.249114] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.249313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.249357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.249552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.285813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.286051] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.286133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.286255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.286403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.286485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.286680] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.286776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.286837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.287168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.287168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.287257] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.287321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.287382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.287520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.287597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.287681] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 1046.356408] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.356720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.356720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.356907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.357074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.394861] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 1046.856129] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1046.856674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.857100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.858975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.858975] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.858975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.858975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.858975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.858975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.858975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.858975] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.362093] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.865993] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6270fe51-9cd9-43e6-84a8-7fa928433147: rpc.has_security_group_logging(os_id): False [ 1047.887596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.887596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.887596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.887596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.888386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.888386] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.888386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.888386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.888386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.888386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.888386] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be created. [ 1047.976291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.976434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.976504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.976724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.976902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.988987] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: IN_PROGRESS for 2s [ 1048.220041] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1048.220319] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1048.220452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.412017] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 1048.413100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.412178] env[66131]: INFO networking_nsxv3.common.synchronization [req-614eff7f-fbc2-479b-88a6-6cfbe689032e req-e846eb14-b2b9-45b5-9a85-a4d809a8274d tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1049.412755] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1049.412922] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd68ac80-456d-40a6-bada-de320b838ff6 with Priority: HIGH for action security_group_rules [ 1049.413319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 with Priority: HIGH for action security_group_rules [ 1049.413319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGH for action security_group_rules [ 1049.413319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGH for action security_group_rules [ 1049.413319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGH for action security_group_rules [ 1049.413450] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda49b5-8fd1-462d-976a-a25d59236231 with Priority: HIGH for action security_group_rules [ 1049.413494] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad174bf4-cd31-47d0-b677-2a143083800a with Priority: HIGH for action security_group_rules [ 1049.413583] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGH for action security_group_rules [ 1049.413677] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 with Priority: HIGH for action security_group_rules [ 1049.413835] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGH for action security_group_rules [ 1049.413869] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af with Priority: HIGH for action security_group_rules [ 1049.413927] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGH for action security_group_rules [ 1049.414020] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGH for action security_group_rules [ 1049.414110] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f876b0-0618-417d-b11e-0e430c4a1630 with Priority: HIGH for action security_group_rules [ 1049.414195] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 with Priority: HIGH for action security_group_rules [ 1049.414281] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 with Priority: HIGH for action security_group_rules [ 1049.414439] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f with Priority: HIGH for action security_group_rules [ 1049.414439] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGH for action security_group_rules [ 1049.414577] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 with Priority: HIGH for action security_group_rules [ 1049.414619] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a with Priority: HIGH for action security_group_rules [ 1049.414937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.415072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.415139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.415334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.415491] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.415587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.415643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.415780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.415931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.416033] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.416921] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd68ac80-456d-40a6-bada-de320b838ff6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.417030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.417117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.417266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.417344] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd68ac80-456d-40a6-bada-de320b838ff6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.418509] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e016bdc-1186-4d65-a6a4-b589ea567689 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.418611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.418678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.418824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.418895] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e016bdc-1186-4d65-a6a4-b589ea567689',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.419596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.419701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.419830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.420146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.420146] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.420653] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.420756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.420820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.420957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.421041] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.422610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.422610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.422610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.422610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.422610] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.423693] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcda49b5-8fd1-462d-976a-a25d59236231 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.424481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.424481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.424481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.424481] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcda49b5-8fd1-462d-976a-a25d59236231',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.424889] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad174bf4-cd31-47d0-b677-2a143083800a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.424992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.425051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.425206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.425309] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad174bf4-cd31-47d0-b677-2a143083800a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.426368] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.426469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.426531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.426679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.426765] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.427542] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.427634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.427710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.427853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.427928] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0d36cff-f4fc-446d-99f9-4c5d0aad46f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.430271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.430373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.430438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.430608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.430676] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.432322] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.432322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.432322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.432322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.432322] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acdbc051-fd26-4fc2-8ede-29b7d3e743af',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.432773] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.432773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.432773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.432773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.433029] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.433596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.433699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.433784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.433934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.434024] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.435147] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6f876b0-0618-417d-b11e-0e430c4a1630 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.435147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.435147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.435147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.435147] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6f876b0-0618-417d-b11e-0e430c4a1630',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.435921] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40da76d9-e82a-4df1-a543-dfbd1d154789 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.435921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.436305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.436305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.436305] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40da76d9-e82a-4df1-a543-dfbd1d154789',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.437217] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.437336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.437400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.437549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.437620] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d77f610-439c-48b3-8ae3-c867ae6ba8f2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.438457] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9664a1c4-6b34-480a-af3f-b95cb52e088f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.438566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.438634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.438802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.438878] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9664a1c4-6b34-480a-af3f-b95cb52e088f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.439570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.439842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.439932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.440096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.440168] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.440847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.440955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.441051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.441203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.441276] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.442374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.442472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.442533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.442680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.442749] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4e8c15-6df2-42fb-824c-bb556c5b499a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.446956] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.446956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.446956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.446956] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.471106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.471289] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.471398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.471551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.471764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.471849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.471950] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be updated. [ 1049.506368] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.506565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.506565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.506840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.506976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.521376] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: IN_PROGRESS for 2s [ 1049.924085] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.924273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.924328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.924528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.924691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.924788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.924887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.925057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.925147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.925235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.925319] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.944426] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.944582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.944637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.944830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.945040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.945144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.945209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.945361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.945482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.945538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.945606] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.953314] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.953464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.953524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.953700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.953848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.953943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.954021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.954162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.954245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.954329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.954426] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.960232] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.960360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.960406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.960621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.960848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.960954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.961031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.961181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.961266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.961349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.961437] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.962317] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.962426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.962491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.962681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.962838] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.962962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.963032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.963826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.963826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.963826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.963826] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.964168] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.964305] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.964374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.964518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.964659] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.964776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.964822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.964991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.966038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.966038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.966038] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.013399] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.013584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.013650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.013864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.015686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.015944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.016631] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.016755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.028272] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.028534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.029319] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.029454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.030167] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.030273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.030944] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.031049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.031743] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.032198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.032603] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.032702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.033510] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1050.033603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.035603] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.035603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.039964] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.040604] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.040701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.041528] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.041975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.042189] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd68ac80-456d-40a6-bada-de320b838ff6 is going to be deleted. [ 1050.043332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.043540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.045461] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.045569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.046437] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.046530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.047188] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.047611] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.047753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.067239] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.067854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.068109] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40da76d9-e82a-4df1-a543-dfbd1d154789 is going to be deleted. [ 1050.069151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.069353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.090878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.091044] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be deleted. [ 1050.091976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.092207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.103712] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.103928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.121328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.121479] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62 is going to be deleted. [ 1050.122472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.122699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.145675] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.145792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.160623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.160777] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9664a1c4-6b34-480a-af3f-b95cb52e088f is going to be deleted. [ 1050.162256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.163065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.193293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.193293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.237556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.237829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.243034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.243346] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d77f610-439c-48b3-8ae3-c867ae6ba8f2 is going to be deleted. [ 1050.244960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.245284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.309429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.309617] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad174bf4-cd31-47d0-b677-2a143083800a is going to be deleted. [ 1050.310913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.311224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.387709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.387918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.389879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.390032] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcda49b5-8fd1-462d-976a-a25d59236231 is going to be deleted. [ 1050.390900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.391138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.399671] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.399885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.427386] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.449973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.450221] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6f876b0-0618-417d-b11e-0e430c4a1630 is going to be deleted. [ 1050.451113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.451407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.452382] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.465918] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.466121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.470861] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.471788] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.472792] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.472963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.473021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.473253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.473501] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.473619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.473696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.473866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.473957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.474061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.474239] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.474334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.474393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.474556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.474745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.474812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.474994] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.475097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.475155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.475270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.475307] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.476254] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.502438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.502438] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4e8c15-6df2-42fb-824c-bb556c5b499a is going to be deleted. [ 1050.503606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.503829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.503925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.504081] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be deleted. [ 1050.505039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.505262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.523601] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.523802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.574963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.574963] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0d36cff-f4fc-446d-99f9-4c5d0aad46f4 is going to be deleted. [ 1050.575583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.575869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.628584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.628584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.637341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.637524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.657544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.657713] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acdbc051-fd26-4fc2-8ede-29b7d3e743af is going to be deleted. [ 1050.658828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.659130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.678927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.679159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.740835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.741044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.753788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.754407] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e016bdc-1186-4d65-a6a4-b589ea567689 is going to be deleted. [ 1050.755597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.755981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.756143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.756342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd68ac80-456d-40a6-bada-de320b838ff6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.756638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.756915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.757080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.757278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40da76d9-e82a-4df1-a543-dfbd1d154789" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.758092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.758397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.759034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.759034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.759034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.759216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.759325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.759546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4481eff-f3b8-4ccf-9ff4-a4270d5b2d62" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.759782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.760049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.760203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.760395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9664a1c4-6b34-480a-af3f-b95cb52e088f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.760623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.761588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.761588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.761588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d77f610-439c-48b3-8ae3-c867ae6ba8f2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.761588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.761588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.762524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.762524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad174bf4-cd31-47d0-b677-2a143083800a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.762524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.762524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.762524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.763047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcda49b5-8fd1-462d-976a-a25d59236231" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.763047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.763171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.763309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.763675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4e8c15-6df2-42fb-824c-bb556c5b499a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.763786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.764429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.764429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.764429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6f876b0-0618-417d-b11e-0e430c4a1630" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.764757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.764868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.765085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.765248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.765586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.765713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.765823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.765980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0d36cff-f4fc-446d-99f9-4c5d0aad46f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.851251] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.851479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.851608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.852287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.852287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.852498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acdbc051-fd26-4fc2-8ede-29b7d3e743af" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.905965] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.906815] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.907085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.907193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.907540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.907710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.907927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e016bdc-1186-4d65-a6a4-b589ea567689" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.929839] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207: rpc.has_security_group_logging(os_id): False [ 1050.954793] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e5ff25-a7e6-4827-af48-1a633ae5e029: rpc.has_security_group_logging(os_id): False [ 1050.963512] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.963682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.963729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.963943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.973631] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30740e8f-2016-47cb-9949-af7efd303581: rpc.has_security_group_logging(os_id): False [ 1050.978308] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4314113-ddb6-40ad-8c52-48dfb885822e: rpc.has_security_group_logging(os_id): False [ 1050.979233] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1050.980640] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a68adb37-f05f-44c4-a13b-7eb7bc0ab766: rpc.has_security_group_logging(os_id): False [ 1051.000910] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.000910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.012229] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.012519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.020833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.020833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.021996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.021996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.022473] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.022564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.031798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.031914] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.031982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.032044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.032282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.032372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.032517] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 is going to be updated. [ 1051.034111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.034329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.083783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.084211] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.084366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.084547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.084629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.084759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.084959] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 is going to be updated. [ 1051.086608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.086911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.121570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.122015] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.122169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.122258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.122460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.122550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.122694] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1051.124023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.124233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.146471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.146669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.147821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.148105] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.148228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.148296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.148549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.148923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.149696] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.149696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.149696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.149696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.150286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.150286] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.150286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.150286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.150286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.150461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.150461] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1051.151755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.151933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.179934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.180272] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.180376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.180446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.180649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.180736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.180831] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1051.181943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.182185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.182321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.183280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.183446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.186413] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.186556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.187869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.187967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.220836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.220836] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.220836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.220836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.220836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.220836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.220836] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1051.221662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.221968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.222268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.223410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.224283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.224283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.226378] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: IN_PROGRESS for 2s [ 1051.315418] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: IN_PROGRESS for 2s [ 1051.319984] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.320181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.320225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.320540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.320758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.327943] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1051.357327] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1051.361351] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.361543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.361543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.361734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.362522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.399140] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1051.424598] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.424598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.424598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.424598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.424598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.547046] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1051.547768] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff deletion is rescheduled due to dependency. [ 1051.547768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.556430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1052.692223] env[66131]: INFO networking_nsxv3.common.synchronization [req-b60a7825-1d14-4d39-9f24-2ac461f654d8 req-e44b0cdc-8262-42f8-ae0c-5931629ed0af tempest-ServerDiskConfigTestJSON-1984435798 tempest-ServerDiskConfigTestJSON-1984435798-project-member] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1052.695473] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGHEST for action security_group_members [ 1052.695919] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.700450] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.700450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.700450] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.207386] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.207386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.207386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.207615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.207615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.207724] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.207834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.209066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.209066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.209066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.209066] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be updated. [ 1053.244478] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: SUCCESS [ 1053.244718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.258589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.258771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.258822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.259217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.259217] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.269230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: IN_PROGRESS for 2s [ 1053.336083] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: SUCCESS [ 1053.336083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.341046] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1053.341292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.373024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1053.373284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.414000] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1053.414262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.427990] env[66131]: INFO networking_nsxv3.common.synchronization [req-190a1b6c-ef7f-4cdc-a8b8-760a52dba253 req-44c553f5-9e61-4753-95ff-1e77767eb206 tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1053.428565] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1053.428879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.429151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.429409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.429588] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.429755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.429907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.429996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.430111] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.568501] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1053.568738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.936029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.936029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.936029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.936029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1053.937319] env[66131]: INFO networking_nsxv3.common.synchronization [req-14507a1a-604d-477e-8b58-68883b340d3b req-40f78b33-6252-416c-947b-b3a0fcb787ad tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1053.938319] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1053.938673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.938803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.938869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.939041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.939190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.939285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.939345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.939492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.939573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.939665] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.964052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.964224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.964264] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.964468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.964607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.973028] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1054.257502] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.257720] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.257856] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.258139] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.258442] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.258559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.258657] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.258860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.259017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.259231] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.259343] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.259449] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.259556] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.259661] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.259764] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.259894] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.279642] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.279642] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.279846] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.279971] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.280281] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-a9eea581-6840-40fa-b06a-436b84ccd001 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.280455] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.280576] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.280919] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.281071] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9eea581-6840-40fa-b06a-436b84ccd001',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.441962] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.785407] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.785633] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.785757] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.786056] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.786215] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.786373] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port a9eea581-6840-40fa-b06a-436b84ccd001 not found, creating... [ 1054.787037] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.787037] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.787037] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.787276] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.787276] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.787507] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.787663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.787825] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.787985] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.788129] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.788266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: a9eea581-6840-40fa-b06a-436b84ccd001 is going to be created. [ 1054.809195] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.809436] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.809574] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.809841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.810078] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.810302] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.944960] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.279511] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6518e255-8a48-4fe6-8c80-b478b31e143a in Status: SUCCESS [ 1055.279697] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a deletion is rescheduled due to dependency. [ 1055.279806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.447209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.447416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.447471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.447661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.447753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.447846] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1055.478211] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.478301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.478361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.478574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.478760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.488224] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1055.497626] env[66131]: INFO networking_nsxv3.common.synchronization [req-14507a1a-604d-477e-8b58-68883b340d3b req-ce43f8c0-76c5-426c-9597-2904cabdca7a service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1055.497867] env[66131]: INFO networking_nsxv3.common.synchronization [req-14507a1a-604d-477e-8b58-68883b340d3b req-ce43f8c0-76c5-426c-9597-2904cabdca7a service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1055.498025] env[66131]: INFO networking_nsxv3.common.synchronization [req-14507a1a-604d-477e-8b58-68883b340d3b req-ce43f8c0-76c5-426c-9597-2904cabdca7a service nova] Enqueued Resource ID: a9eea581-6840-40fa-b06a-436b84ccd001 with Priority: HIGHEST for action port [ 1055.498555] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1055.498691] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1055.498805] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9eea581-6840-40fa-b06a-436b84ccd001 with Priority: HIGHEST for action port [ 1055.499173] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.499332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.499375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.499586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.499802] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.500838] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.500838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.501063] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9eea581-6840-40fa-b06a-436b84ccd001 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.501063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.501247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.501288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.501711] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9eea581-6840-40fa-b06a-436b84ccd001',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.929743] env[66131]: INFO networking_nsxv3.common.synchronization [None req-66e0d4bf-2bd6-4180-b5fd-e02c0acddc54 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_rules [ 1055.930986] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_rules [ 1055.931469] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.931652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.931947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.932159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.932280] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.983992] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1055.984562] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 deletion is rescheduled due to dependency. [ 1055.984562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.003295] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.003508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.003954] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9eea581-6840-40fa-b06a-436b84ccd001 with status ACTIVE [ 1056.003954] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.004156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.004156] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.004282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.004366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.004545] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.004652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.004693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.005137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.005137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.005271] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.005491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.005491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.005591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.005666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.005763] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9eea581-6840-40fa-b06a-436b84ccd001 is going to be updated. [ 1056.042564] env[66131]: INFO networking_nsxv3.common.synchronization [None req-f89ef27e-d765-4387-b12f-86afa33decd3 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_rules [ 1056.043953] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.044151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.044211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.044625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.044829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.045176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9eea581-6840-40fa-b06a-436b84ccd001" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.045857] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_rules [ 1056.046337] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.046554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.457016] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.457202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.457302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.457480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.457570] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.457663] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 already deleted. [ 1056.458405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.458405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.458405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.458650] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.981416] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.981598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.981686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.981848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.981940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.982047] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 already deleted. [ 1056.982129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.499290] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1057.499290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.499708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.499753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.500403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.500403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.500403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.500612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.500612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.500701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.004078] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.200588] env[66131]: INFO networking_nsxv3.common.synchronization [req-c9090356-5495-4b27-bf85-5b7f8e155268 req-69e5aa6f-78f4-4fba-ba5a-f93231e43f94 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1058.200948] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1058.201310] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.201472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.201531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.202023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.202023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.202023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.202230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.202350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.202350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.202440] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.506793] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.556935] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.557206] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.557359] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.557647] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.557907] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.558221] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.558380] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.558632] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.558946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.559098] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.559162] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.559247] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.559355] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.559472] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.559576] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.559706] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.580024] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.580228] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1058.580343] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.580521] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.580840] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-c140e8b8-db48-43c0-a002-932ddd5418a0 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.581019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.581139] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.581481] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.581682] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c140e8b8-db48-43c0-a002-932ddd5418a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.705532] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.705676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.705761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.706025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.706161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.706370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.706476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.706528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.706694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.706770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.706856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be deleted. [ 1058.737350] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.737532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.737585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.737765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.737857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.738053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.010023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.010023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.010023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.010023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.010023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.010023] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1059.041672] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.041889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.042024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.042346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.042572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.054138] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1059.084354] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.084633] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.084737] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.085247] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.085527] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.085711] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port c140e8b8-db48-43c0-a002-932ddd5418a0 not found, creating... [ 1059.085989] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.086177] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.086299] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.086546] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.086763] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.087229] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.087475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.087679] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.087984] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.088190] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.088379] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: c140e8b8-db48-43c0-a002-932ddd5418a0 is going to be created. [ 1059.115055] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.115438] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.115653] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.116109] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.116455] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.116814] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.803586] env[66131]: INFO networking_nsxv3.common.synchronization [req-c9090356-5495-4b27-bf85-5b7f8e155268 req-a67ff62e-3aef-4796-8e46-68c7705ba789 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1059.803832] env[66131]: INFO networking_nsxv3.common.synchronization [req-c9090356-5495-4b27-bf85-5b7f8e155268 req-a67ff62e-3aef-4796-8e46-68c7705ba789 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1059.803908] env[66131]: INFO networking_nsxv3.common.synchronization [req-c9090356-5495-4b27-bf85-5b7f8e155268 req-a67ff62e-3aef-4796-8e46-68c7705ba789 service nova] Enqueued Resource ID: c140e8b8-db48-43c0-a002-932ddd5418a0 with Priority: HIGHEST for action port [ 1059.804449] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1059.804585] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1059.804685] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c140e8b8-db48-43c0-a002-932ddd5418a0 with Priority: HIGHEST for action port [ 1059.804992] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.805202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.805272] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.805478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.805568] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.806497] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.806608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.806676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.806862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.807024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.807130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.807193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.807335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.807420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.807507] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.808384] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-c140e8b8-db48-43c0-a002-932ddd5418a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.808457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.808457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.808637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.808694] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c140e8b8-db48-43c0-a002-932ddd5418a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.312025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.312025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.312025] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.312504] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c140e8b8-db48-43c0-a002-932ddd5418a0 with status ACTIVE [ 1060.312770] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.312955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.313092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.313402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.313543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.313812] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.313960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.314106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.314419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.314590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.314850] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.315052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.315160] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.315331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.316051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.316051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c140e8b8-db48-43c0-a002-932ddd5418a0 is going to be updated. [ 1060.343083] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.343245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.343321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.343510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.343648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.343805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c140e8b8-db48-43c0-a002-932ddd5418a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.817676] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.064419] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1061.064654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.064823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.065149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.065396] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.065459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.065494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.065640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.065718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.065799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.065885] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.322221] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.322221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.322221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.322221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.322221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.322221] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be created. [ 1061.348383] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.348383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.348383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.348383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.348383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.360508] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: UNINITIALIZED for 2s [ 1061.568226] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.568449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.568449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.568700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.569261] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.569484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.569484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.569668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.569668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.569795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.569912] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.570039] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.570147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.570242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.570364] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.570455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.570510] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.570640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.570732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.570784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.570870] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.074063] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1062.091871] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.092077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.092995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.092995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.092995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.092995] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.092995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.092995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.092995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.093281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.093281] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.093371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.093414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.093535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.093617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.093800] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.093893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.093953] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.096029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.096159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.096357] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1062.160852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.161121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.161252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.161553] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.161738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.178544] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1063.287857] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d5cd237-3419-4385-86ca-c542ce058507 req-5e70a895-4961-4ae2-82df-55b43b8f0db0 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1063.288171] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1063.288382] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.288502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.288565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.288753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.288931] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.289120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.289547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.289547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.289547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.289547] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.371760] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1063.371760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.372480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.372765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.373049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.373205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.373285] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.373453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.373537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.373624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.373731] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.695607] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.695803] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.696034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.696223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.696472] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.696624] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.699860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.699860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.699860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.699860] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.699860] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.699860] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.699860] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.699860] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.699860] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.699860] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.722123] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.722344] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1063.722437] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.722607] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.722937] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.723171] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.723400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.723618] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.723756] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e46fb976-6ba9-4c0b-b39c-892d7e83ce21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.792961] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.876026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.876269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.876332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.876694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.876906] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.877040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.877118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.877311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.877390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.877525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.877797] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.877943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.878019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.878181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.878371] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.878476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.878596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.878824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.878966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.879100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.879198] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.192459] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1064.192719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.226417] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.226854] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.227136] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.227511] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.227699] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.227955] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port e46fb976-6ba9-4c0b-b39c-892d7e83ce21 not found, creating... [ 1064.228390] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.228584] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.229023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.229023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.229170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.229526] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.229694] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.229811] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.230096] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.230250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.230395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: e46fb976-6ba9-4c0b-b39c-892d7e83ce21 is going to be created. [ 1064.254764] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.255063] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.255174] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.255477] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.255709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.255931] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.295622] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.381101] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95303b6-7e26-444d-bfa3-5518dbc80e21: rpc.has_security_group_logging(os_id): False [ 1064.402049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.402288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.402288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.402409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.402509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.402710] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.402817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.402881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.403078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.403165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.403459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.403558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.403623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.403775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.403855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.404065] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.404187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.404255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.404404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.404495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.404587] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be created. [ 1064.536796] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.536950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.537035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.537300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.537504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.554021] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1064.797909] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.798255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.798255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.798482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.798482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.798718] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be updated. [ 1064.828847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.829225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.829225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.829374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.829509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.842203] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: IN_PROGRESS for 2s [ 1064.887648] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e4da63ff-b775-424b-bed5-70c0a3ee2b76 None None] Enqueued Resource ID: 834dd633-d845-42af-a3a2-61e554d8420b with Priority: HIGHEST for action port [ 1064.889213] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 834dd633-d845-42af-a3a2-61e554d8420b with Priority: HIGHEST for action port [ 1064.889213] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-834dd633-d845-42af-a3a2-61e554d8420b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.889213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-834dd633-d845-42af-a3a2-61e554d8420b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.889213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-834dd633-d845-42af-a3a2-61e554d8420b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.889213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-834dd633-d845-42af-a3a2-61e554d8420b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.889213] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('834dd633-d845-42af-a3a2-61e554d8420b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.002658] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d5cd237-3419-4385-86ca-c542ce058507 req-dfb2e24f-8775-4f9f-baec-17d6839b542a service nova] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1065.002658] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d5cd237-3419-4385-86ca-c542ce058507 req-dfb2e24f-8775-4f9f-baec-17d6839b542a service nova] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1065.002812] env[66131]: INFO networking_nsxv3.common.synchronization [req-0d5cd237-3419-4385-86ca-c542ce058507 req-dfb2e24f-8775-4f9f-baec-17d6839b542a service nova] Enqueued Resource ID: e46fb976-6ba9-4c0b-b39c-892d7e83ce21 with Priority: HIGHEST for action port [ 1065.003255] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_rules [ 1065.003389] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1065.003497] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e46fb976-6ba9-4c0b-b39c-892d7e83ce21 with Priority: HIGHEST for action port [ 1065.006522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.006594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.006687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.006857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.006940] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.007839] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.007930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.008406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.008515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.008582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.008763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.008837] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e46fb976-6ba9-4c0b-b39c-892d7e83ce21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.391840] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 834dd633-d845-42af-a3a2-61e554d8420b [ 1065.392233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.392410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.392480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.392939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.392939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.392939] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:834dd633-d845-42af-a3a2-61e554d8420b already deleted. [ 1065.392939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-834dd633-d845-42af-a3a2-61e554d8420b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.510635] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.510776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.513651] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e46fb976-6ba9-4c0b-b39c-892d7e83ce21 with status ACTIVE [ 1065.513651] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.513651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.513651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.513885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.513885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.513954] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.514023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.514083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.514292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.514343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.515302] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.515302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.515302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.515302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.515302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.515302] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e46fb976-6ba9-4c0b-b39c-892d7e83ce21 is going to be updated. [ 1065.539312] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.539485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.539533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.539742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.539885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.540065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e46fb976-6ba9-4c0b-b39c-892d7e83ce21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.568942] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1066.568942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.853269] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1066.853543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.853768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.854040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.854406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.854629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.855090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.855351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.855495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.855653] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.109202] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5690b724-b479-41f2-862f-24bc4767658d None None] Enqueued Resource ID: 817bbe05-bd4f-4f82-815a-22bc37ea5ff1 with Priority: HIGHEST for action port [ 1067.109726] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817bbe05-bd4f-4f82-815a-22bc37ea5ff1 with Priority: HIGHEST for action port [ 1067.110084] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-817bbe05-bd4f-4f82-815a-22bc37ea5ff1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.110196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-817bbe05-bd4f-4f82-815a-22bc37ea5ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.110275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-817bbe05-bd4f-4f82-815a-22bc37ea5ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.110511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-817bbe05-bd4f-4f82-815a-22bc37ea5ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.110591] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('817bbe05-bd4f-4f82-815a-22bc37ea5ff1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.358311] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.616458] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 817bbe05-bd4f-4f82-815a-22bc37ea5ff1 [ 1067.616751] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.616853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.616929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.617152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.617245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.617343] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:817bbe05-bd4f-4f82-815a-22bc37ea5ff1 already deleted. [ 1067.617558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-817bbe05-bd4f-4f82-815a-22bc37ea5ff1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.862221] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.990575] env[66131]: INFO networking_nsxv3.common.synchronization [req-387452b8-bb1d-4603-b05e-187178b6aa2b req-9f7aa134-fee8-4bf7-8058-69c0adbb3769 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_members [ 1067.991658] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_members [ 1067.992900] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.993142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.993269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.993697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.993976] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.994208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.994328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.994630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.994803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.994984] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.365423] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.365712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.365712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.366149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.366149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.366149] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be updated. [ 1068.376944] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.377208] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.377329] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.377645] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.377891] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.378061] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.378192] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.378672] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.378672] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.378770] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.378883] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.378987] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.379284] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.379474] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.379582] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.379783] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.401947] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.402196] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.402365] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.402526] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.402867] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-645b7b40-9d9e-4141-938b-f16df18f1dc9 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.403203] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.403339] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.403676] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.403812] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645b7b40-9d9e-4141-938b-f16df18f1dc9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.407208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.407320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.407384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.407608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.407753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.418571] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: IN_PROGRESS for 2s [ 1068.497719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.498389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.498389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.498389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.498678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.498867] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.499055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.499097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.499317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.499422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.499582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 already deleted. [ 1068.499626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.906816] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.907125] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.907212] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.907601] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.907801] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.908116] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 645b7b40-9d9e-4141-938b-f16df18f1dc9 not found, creating... [ 1068.908276] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.908435] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.908553] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.908768] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.908905] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.909202] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.909350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.909507] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.909663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.909793] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.909930] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 645b7b40-9d9e-4141-938b-f16df18f1dc9 is going to be created. [ 1068.930383] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.930606] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.930732] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.931032] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.931268] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.931500] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.252499] env[66131]: INFO networking_nsxv3.common.synchronization [req-6c2cd96d-9b5b-4622-ab29-1b4241b33cef req-352869d5-3bdd-4e00-b19f-75493f051ff8 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1069.253519] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1069.253805] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.253933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.254010] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.254457] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.254623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.254750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.254816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.254972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.255163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.255252] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.669630] env[66131]: INFO networking_nsxv3.common.synchronization [req-387452b8-bb1d-4603-b05e-187178b6aa2b req-1237433a-409c-4dcd-910a-d6d8ea166e77 service nova] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_rules [ 1069.670062] env[66131]: INFO networking_nsxv3.common.synchronization [req-387452b8-bb1d-4603-b05e-187178b6aa2b req-1237433a-409c-4dcd-910a-d6d8ea166e77 service nova] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_members [ 1069.670062] env[66131]: INFO networking_nsxv3.common.synchronization [req-387452b8-bb1d-4603-b05e-187178b6aa2b req-1237433a-409c-4dcd-910a-d6d8ea166e77 service nova] Enqueued Resource ID: 645b7b40-9d9e-4141-938b-f16df18f1dc9 with Priority: HIGHEST for action port [ 1069.670554] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_rules [ 1069.670684] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_members [ 1069.670781] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645b7b40-9d9e-4141-938b-f16df18f1dc9 with Priority: HIGHEST for action port [ 1069.671065] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.671226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.671319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.671537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.671600] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.672463] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.672575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.672641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.672826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.672946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.673046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.673112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.673242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.674844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.674844] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.674844] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-645b7b40-9d9e-4141-938b-f16df18f1dc9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.674844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.674844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.674844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.674844] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645b7b40-9d9e-4141-938b-f16df18f1dc9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.757667] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.176247] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.176509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.176890] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 645b7b40-9d9e-4141-938b-f16df18f1dc9 with status ACTIVE [ 1070.176890] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.176890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.177057] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.177356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.177356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.177539] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.177608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.177640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.178599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.178599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.178599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.178599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.178599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.178599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.178599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.178599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 645b7b40-9d9e-4141-938b-f16df18f1dc9 is going to be updated. [ 1070.179631] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.200751] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.200923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.201013] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.201206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.201345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.201502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-645b7b40-9d9e-4141-938b-f16df18f1dc9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.262723] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.381741] env[66131]: INFO networking_nsxv3.common.synchronization [req-96ea96e5-26a6-4340-8636-5b8285ae1414 req-f1f15235-83c7-4277-976b-a61e5c4f47ab tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1070.382839] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1070.382839] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.382839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.382839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.383036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.383125] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.383191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.383277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.383390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.383718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.383718] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.429792] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1070.430623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.430623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.430623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.430623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.430623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.430879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.430879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.430879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.430997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.431056] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.682564] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.737061] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.737211] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.737291] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.737573] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.737858] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.737996] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.738151] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.738380] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.738539] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.738780] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.738887] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.738988] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.739125] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.739251] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.739366] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.739506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.759550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.759745] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.759932] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.760175] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.760552] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-16aa56e6-3f64-4130-bb71-e11ea0173b6d taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.760767] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.760920] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.761346] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.761520] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16aa56e6-3f64-4130-bb71-e11ea0173b6d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.764608] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.764852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.764903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.765242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.765725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.765866] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1070.798172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.798328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.798386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.798595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.798737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.810817] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1070.885560] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.885714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.885787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.886015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.886207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.886403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.886503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.886565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.886744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.886845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.886920] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1070.911830] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.911830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.911830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.912093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.912093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.921080] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1070.933579] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.185208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.185636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.185636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.185798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.185957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.186138] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 is going to be created. [ 1071.212627] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.212800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.212832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.213089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.213263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.224075] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: UNINITIALIZED for 2s [ 1071.266223] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.266223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.266223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.266223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.266223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.266223] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 16aa56e6-3f64-4130-bb71-e11ea0173b6d not found, creating... [ 1071.266223] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.266712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.266712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.267077] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.267324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.267756] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.267997] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.268220] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.268533] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.268750] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.268971] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 16aa56e6-3f64-4130-bb71-e11ea0173b6d is going to be created. [ 1071.319360] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.319582] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.319639] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.319946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.320217] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.320525] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.439457] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6270fe51-9cd9-43e6-84a8-7fa928433147: rpc.has_security_group_logging(os_id): False [ 1071.463870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.464071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.464109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.464300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.464396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.464645] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.464745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.464809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.464957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.465044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.465168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be updated. [ 1071.533760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.533991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.533991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.534215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.534376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.550065] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: IN_PROGRESS for 2s [ 1072.020719] env[66131]: INFO networking_nsxv3.common.synchronization [req-96ea96e5-26a6-4340-8636-5b8285ae1414 req-7d047675-2dc0-49d7-990d-9b0f1906d8f6 service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 1072.020719] env[66131]: INFO networking_nsxv3.common.synchronization [req-96ea96e5-26a6-4340-8636-5b8285ae1414 req-7d047675-2dc0-49d7-990d-9b0f1906d8f6 service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1072.020719] env[66131]: INFO networking_nsxv3.common.synchronization [req-96ea96e5-26a6-4340-8636-5b8285ae1414 req-7d047675-2dc0-49d7-990d-9b0f1906d8f6 service nova] Enqueued Resource ID: 16aa56e6-3f64-4130-bb71-e11ea0173b6d with Priority: HIGHEST for action port [ 1072.020719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 1072.020719] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1072.021660] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16aa56e6-3f64-4130-bb71-e11ea0173b6d with Priority: HIGHEST for action port [ 1072.021660] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.021660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.022336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.022336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.022336] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.023143] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.023359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.023571] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-16aa56e6-3f64-4130-bb71-e11ea0173b6d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.023739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.023848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.024129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.024250] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16aa56e6-3f64-4130-bb71-e11ea0173b6d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.527111] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.527467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.527467] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16aa56e6-3f64-4130-bb71-e11ea0173b6d with status ACTIVE [ 1072.527612] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.528397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.528397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.528397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.528397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.528397] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.528726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.528726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.528726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.528865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.529425] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.529425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.529425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.529425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.529425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.529425] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16aa56e6-3f64-4130-bb71-e11ea0173b6d is going to be updated. [ 1072.560850] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.560850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.560850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.560850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.560850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.560850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16aa56e6-3f64-4130-bb71-e11ea0173b6d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.825796] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1072.826113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.931329] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1072.931521] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 deletion is rescheduled due to dependency. [ 1072.931693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.931897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.932147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.932336] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.932468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.932534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.932694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.932777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.932876] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.238359] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: UNINITIALIZED for 4s [ 1073.421099] env[66131]: INFO networking_nsxv3.common.synchronization [None req-e67993f4-6a55-4ea8-b463-c41d87136a94 tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1073.421623] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1073.421930] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.422105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.422181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.422381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.422533] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.423014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.423014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.423123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.423891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.424032] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.438379] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.565546] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1073.565808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.762661] env[66131]: INFO networking_nsxv3.common.synchronization [req-beb5a749-81c5-4f22-9c60-dc7bf8cfd43d req-4ac667f8-8940-4ff4-844e-eba6b61de671 tempest-ServerGroupTestJSON-477443117 tempest-ServerGroupTestJSON-477443117-project-member] Enqueued Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_members [ 1073.763657] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_members [ 1073.763827] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.763981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.764066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.764757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.764757] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.764757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.764942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.764942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.765073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.765178] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.927662] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.927893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.928034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.928433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.928518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.928774] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.928920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.929034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.929276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.929382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.929635] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be deleted. [ 1073.941883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.967554] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.967735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.967914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.968177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.968538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.968538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.178449] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.178657] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-875" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.180036] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-875" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.180036] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-875" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.180036] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.180036] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.180300] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.180326] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.180448] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.180651] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.180756] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.180858] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.180964] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.181109] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.181216] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.181362] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.208642] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.208811] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.208961] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.210049] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-875" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.210049] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.210049] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.210049] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.210325] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.210325] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4758f1d0-1703-46d4-880e-ab2ad6b02cb1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.267670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.267841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.267881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.268130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.268222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.268417] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.268518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.268580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.268728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.268805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.268886] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd already deleted. [ 1074.268965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.444701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.444845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.444905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.445230] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.445372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.445529] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1074.480918] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.481115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.481115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.481349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.482482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.492688] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1074.713215] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.713474] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.713548] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.714542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.714542] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.714617] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 4758f1d0-1703-46d4-880e-ab2ad6b02cb1 not found, creating... [ 1074.715490] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.715490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.715490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.715490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.718259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.718259] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.718259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.718259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.718259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.718259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.718259] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 4758f1d0-1703-46d4-880e-ab2ad6b02cb1 is going to be created. [ 1074.738831] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.739087] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.739219] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.743147] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.743147] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.743147] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.253401] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: SUCCESS [ 1075.254191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.254191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.254191] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.254700] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.254700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.254700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.254700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.254700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.255569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.255569] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.474653] env[66131]: INFO networking_nsxv3.common.synchronization [req-beb5a749-81c5-4f22-9c60-dc7bf8cfd43d req-07925a1b-6e85-4242-818f-06686f55fc89 service nova] Enqueued Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_rules [ 1075.474797] env[66131]: INFO networking_nsxv3.common.synchronization [req-beb5a749-81c5-4f22-9c60-dc7bf8cfd43d req-07925a1b-6e85-4242-818f-06686f55fc89 service nova] Enqueued Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_members [ 1075.474964] env[66131]: INFO networking_nsxv3.common.synchronization [req-beb5a749-81c5-4f22-9c60-dc7bf8cfd43d req-07925a1b-6e85-4242-818f-06686f55fc89 service nova] Enqueued Resource ID: 4758f1d0-1703-46d4-880e-ab2ad6b02cb1 with Priority: HIGHEST for action port [ 1075.477227] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_rules [ 1075.477227] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_members [ 1075.477387] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4758f1d0-1703-46d4-880e-ab2ad6b02cb1 with Priority: HIGHEST for action port [ 1075.477679] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.477809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.477896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.478302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.478396] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.480872] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.480872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.480872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.480872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.481099] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.481143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.482771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.482771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.482771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.482771] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.482771] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.482771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.482771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.482771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.482771] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4758f1d0-1703-46d4-880e-ab2ad6b02cb1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.758917] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.985041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.985041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.986963] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.990581] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4758f1d0-1703-46d4-880e-ab2ad6b02cb1 with status ACTIVE [ 1075.990581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.990581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.990581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.990581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.990581] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4758f1d0-1703-46d4-880e-ab2ad6b02cb1 is going to be updated. [ 1076.015428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.015428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.015428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.015428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.015428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.015428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4758f1d0-1703-46d4-880e-ab2ad6b02cb1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.264652] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95: rpc.has_security_group_logging(os_id): False [ 1076.284435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.284591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.284663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.284895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.285041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.285365] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.285465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.285567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.285736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.285818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.285924] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 is going to be created. [ 1076.379412] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.379606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.379722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.380019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.380228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.397151] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: IN_PROGRESS for 2s [ 1076.491978] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.509792] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1076.510011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.510225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.510417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.510607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.510785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.510848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.511015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.511058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.511153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.511229] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.994874] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.995180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.995423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.995695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.995804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.995913] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd is going to be created. [ 1077.013842] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.029804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.029986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.030035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.030228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.030392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.041921] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd in Status: UNINITIALIZED for 2s [ 1077.515638] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30740e8f-2016-47cb-9949-af7efd303581: rpc.has_security_group_logging(os_id): False [ 1077.545656] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.545919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.545919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.546218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.546323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.546630] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.546764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.546843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.547080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.547169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.547273] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1077.566659] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.566960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.567085] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.567306] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.567609] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.567827] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.567827] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.570124] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.571146] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.571387] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.571507] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.571670] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.571741] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.571852] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.572014] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.572102] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.591621] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.591851] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.592097] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.592319] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.592725] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-948e9566-c4a9-4e23-aa58-db0dfc207a23 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.592904] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.593062] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.593429] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.593564] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('948e9566-c4a9-4e23-aa58-db0dfc207a23',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.620955] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.621147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.621270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.621417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.621569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.635965] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1078.099303] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.099676] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.099676] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.103018] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.103018] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.103018] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.103400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.103400] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.103400] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 is going to be updated. [ 1078.132973] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.133505] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.133505] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.133901] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.133961] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.134180] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.408506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: SUCCESS [ 1078.408744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.919821] env[66131]: INFO networking_nsxv3.common.synchronization [req-78ec747d-9aa7-40e3-b684-a90da537e927 req-3655dec1-6972-44e2-a600-df90fb7326af service nova] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 1078.919933] env[66131]: INFO networking_nsxv3.common.synchronization [req-78ec747d-9aa7-40e3-b684-a90da537e927 req-3655dec1-6972-44e2-a600-df90fb7326af service nova] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 1078.920088] env[66131]: INFO networking_nsxv3.common.synchronization [req-78ec747d-9aa7-40e3-b684-a90da537e927 req-3655dec1-6972-44e2-a600-df90fb7326af service nova] Enqueued Resource ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 with Priority: HIGHEST for action port [ 1078.921604] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_rules [ 1078.921604] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 1078.923049] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 with Priority: HIGHEST for action port [ 1078.923049] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.923234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.923810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.924053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.924146] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.925141] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.925346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.925346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.926736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.927054] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.927175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.927242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.929456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.929456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.929456] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.930221] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-948e9566-c4a9-4e23-aa58-db0dfc207a23 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.930221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.930334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.931045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.931045] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('948e9566-c4a9-4e23-aa58-db0dfc207a23',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.058093] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd in Status: SUCCESS [ 1079.058093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.058093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.058093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.060753] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.060753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.060753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.060753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.060753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.060753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.060753] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.432816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.433222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.433222] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.435027] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 948e9566-c4a9-4e23-aa58-db0dfc207a23 with status ACTIVE [ 1079.435142] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.435558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.435558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.435831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.435981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.436220] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.436341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.436414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.436691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.436691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.436946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.437061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.437131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.437304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.437387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.437588] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 948e9566-c4a9-4e23-aa58-db0dfc207a23 is going to be updated. [ 1079.462738] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.462738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.462738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.462738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.463144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.463144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-948e9566-c4a9-4e23-aa58-db0dfc207a23" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.563293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.563489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.563527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.563842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.564060] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.564233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.564304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.564515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.564573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.564794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.564968] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.565110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.565192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.565445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.565623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.565769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.565825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.566041] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.566082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.566165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.566682] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.652396] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1079.652662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.935503] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.068742] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68c9165c-8a0c-4c77-ac74-d69dfa2767dd: rpc.has_security_group_logging(os_id): False [ 1080.092230] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.092371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.092446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.092652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.092745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.092959] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.093069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.093134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.093284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.093358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.093586] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.093703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.093735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.093897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.093930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.094154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.094203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.094244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.094418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.094447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.094521] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd is going to be created. [ 1080.160116] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.160300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.160367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.160624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.160816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.174509] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd in Status: IN_PROGRESS for 2s [ 1080.438219] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.438733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.438733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.438825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.438873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.438977] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 is going to be updated. [ 1080.480879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.481071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.481148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.481375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.481528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.492393] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: IN_PROGRESS for 2s [ 1080.963060] env[66131]: INFO networking_nsxv3.common.synchronization [req-49c6cbae-c53a-4428-ab52-757d08ff6849 req-10d6bd61-8e0c-4a24-a9d2-5dc578cf6c42 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1080.963724] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1080.966295] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.966426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.966426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.966629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.966844] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.966946] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.967033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.967221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.967308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.967458] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.295513] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.295759] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.295889] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.296438] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.296727] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.296941] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.297084] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.297330] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.297541] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.297823] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.297943] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.298360] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.298360] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.298360] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.298490] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.298517] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.325982] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.326249] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1081.326410] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.326644] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.327264] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-af706bce-7759-4520-b140-772e2d02390e taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.327491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.327679] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.328246] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.328433] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af706bce-7759-4520-b140-772e2d02390e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.475082] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.831621] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.831958] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.832189] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.832619] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.832841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.833124] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port af706bce-7759-4520-b140-772e2d02390e not found, creating... [ 1081.833553] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.833813] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.834024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.834357] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.834674] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.835136] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.835430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.835610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.835987] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.836166] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.836408] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: af706bce-7759-4520-b140-772e2d02390e is going to be created. [ 1081.858592] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.858929] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.859151] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.859601] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.859928] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.860290] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.978070] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.189124] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd in Status: SUCCESS [ 1082.189384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.485446] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.485446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.485446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.485753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.485753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.485882] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1082.518544] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: SUCCESS [ 1082.518799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.518973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.519261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.519600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.519835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.520147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.520675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.520675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.520759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.520863] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.534745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.534942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.534999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.535416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.535647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.546945] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1082.607976] env[66131]: INFO networking_nsxv3.common.synchronization [req-49c6cbae-c53a-4428-ab52-757d08ff6849 req-9db6a2a7-0bf7-40c4-97da-bafe99de60e1 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1082.608917] env[66131]: INFO networking_nsxv3.common.synchronization [req-49c6cbae-c53a-4428-ab52-757d08ff6849 req-9db6a2a7-0bf7-40c4-97da-bafe99de60e1 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1082.609282] env[66131]: INFO networking_nsxv3.common.synchronization [req-49c6cbae-c53a-4428-ab52-757d08ff6849 req-9db6a2a7-0bf7-40c4-97da-bafe99de60e1 service nova] Enqueued Resource ID: af706bce-7759-4520-b140-772e2d02390e with Priority: HIGHEST for action port [ 1082.610123] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1082.610314] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1082.610480] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af706bce-7759-4520-b140-772e2d02390e with Priority: HIGHEST for action port [ 1082.610838] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.610996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.611106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.611334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.611448] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.612402] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.616025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.616025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-af706bce-7759-4520-b140-772e2d02390e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.616025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.616025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.616025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.616025] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af706bce-7759-4520-b140-772e2d02390e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.023681] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.115190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.115456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.115649] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af706bce-7759-4520-b140-772e2d02390e with status ACTIVE [ 1083.115942] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.116082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.116177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.116460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.116560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.116741] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.116856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.116926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.117103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.117188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.117392] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.117489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.117629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.117745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.117828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.117916] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af706bce-7759-4520-b140-772e2d02390e is going to be updated. [ 1083.145341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.145639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.145639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.146892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.146892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.146892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af706bce-7759-4520-b140-772e2d02390e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.525864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 635d180a-1a27-4897-8f2c-a14eca9102c1: rpc.has_security_group_logging(os_id): False [ 1083.549202] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.549445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.549445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.549690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.591046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.591400] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.591637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.591776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.592126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.592220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.592317] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 is going to be updated. [ 1083.697849] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.698042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.698107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.698336] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.699058] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.717772] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: IN_PROGRESS for 2s [ 1084.558855] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1084.558855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.559280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.559362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.559584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.559739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.559804] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.560193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.560193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.560193] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.062401] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.565464] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.735366] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: SUCCESS [ 1085.735620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.764068] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.764296] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.764425] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.764717] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.764996] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.765170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.765286] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.765595] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.765744] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.765955] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.766086] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.766201] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.766319] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.766628] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.766759] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.766891] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.787280] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.787444] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.787495] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.787734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.788102] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-02cf995f-5b39-4612-9010-ab9060fca3e4 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.788290] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.788412] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.788760] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.788902] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02cf995f-5b39-4612-9010-ab9060fca3e4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.068048] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.068278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.068348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.068574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.068644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.068690] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1086.105379] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.105576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.105657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.105833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.105984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.117208] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1086.292378] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.292638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.292812] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.293420] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.293541] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.293731] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 02cf995f-5b39-4612-9010-ab9060fca3e4 not found, creating... [ 1086.294231] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.294505] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.294668] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.294948] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.295152] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.295680] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.295909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.296047] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.296365] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.296626] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.296868] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 is going to be created. [ 1086.323071] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.323349] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.323461] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.323743] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.323979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.324249] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.050598] env[66131]: INFO networking_nsxv3.common.synchronization [req-83e17af1-c451-427d-b160-9379c7a081d9 req-63ec3f8f-dde3-47e2-a507-c9005dc5fbcc service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 1087.050873] env[66131]: INFO networking_nsxv3.common.synchronization [req-83e17af1-c451-427d-b160-9379c7a081d9 req-63ec3f8f-dde3-47e2-a507-c9005dc5fbcc service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1087.050939] env[66131]: INFO networking_nsxv3.common.synchronization [req-83e17af1-c451-427d-b160-9379c7a081d9 req-63ec3f8f-dde3-47e2-a507-c9005dc5fbcc service nova] Enqueued Resource ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 with Priority: HIGHEST for action port [ 1087.051599] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 1087.051757] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1087.051861] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 with Priority: HIGHEST for action port [ 1087.055961] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.056129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.056221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.056580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.056703] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.057835] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.057967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.058037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.058249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.058417] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.058540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.058615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.058779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.058864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.058962] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.060549] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-02cf995f-5b39-4612-9010-ab9060fca3e4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.060549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.060549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.060549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.061725] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02cf995f-5b39-4612-9010-ab9060fca3e4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.562929] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.564100] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.564262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.564364] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02cf995f-5b39-4612-9010-ab9060fca3e4 with status ACTIVE [ 1087.564521] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.564636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.564689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.564902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.564984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.565556] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.565556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.565556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.565872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.565954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.566257] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.566382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.566489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.566700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.566808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.566928] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 is going to be updated. [ 1087.590440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.590651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.590754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.591037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.591238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.591451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.069203] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.128181] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1088.128471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.128637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.128865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.129097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.129234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.129316] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.129497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.129590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.129678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.129796] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.571882] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.573208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.573208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.573208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.573208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.573208] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be created. [ 1088.600743] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.600965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.601059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.602024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.602024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.611760] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: UNINITIALIZED for 2s [ 1088.632407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.632599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.632642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.632952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.633273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.633428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.633513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.633752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.633883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.634032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.634190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.634326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.634422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.634543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.634750] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.634849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.634913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.635086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.635182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.635290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.635468] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.137633] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1089.158697] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.158942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.159132] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.159383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.159505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.159717] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.159823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.159888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.160081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.160163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.160361] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.160542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.160615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.160792] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.160910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.161060] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.161165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.161228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.161693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.161693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.161784] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1089.252650] env[66131]: INFO networking_nsxv3.common.synchronization [req-365cca9c-1c0c-4cbc-86e6-2be41883bfcf req-a038f0e7-18d5-4a05-82e0-824febe8aa7f tempest-ServerGroupTestJSON-477443117 tempest-ServerGroupTestJSON-477443117-project-member] Enqueued Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_members [ 1089.254191] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.254617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.254617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.254617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.254812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.256322] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGHEST for action security_group_members [ 1089.256682] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.256818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.256892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.257117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.257303] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.257414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.257479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.257644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.257761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.257907] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.274182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1089.763029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.763029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.763029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.763029] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd is going to be updated. [ 1089.826777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.826777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.826777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.826777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.826777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.845761] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd in Status: IN_PROGRESS for 2s [ 1090.631030] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1090.631380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.631380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.631518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.631705] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.631964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.631964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.632107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.632141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.632300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.632358] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.135345] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.135345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.135345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.135345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.135729] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.135729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.135729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.135854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.135947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.136044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.136190] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.136282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.136351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.136556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.136693] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.136785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.136844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.136979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.137066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.137147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.137237] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.292553] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1091.292728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.640468] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3951e5e1-7963-4597-8681-5924c72de16e: rpc.has_security_group_logging(os_id): False [ 1091.664424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.664757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.664757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.665098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.665098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.665268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.665350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.665409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.665569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.665653] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.666028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.666344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.666344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.666344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.666344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.666566] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.666646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.666746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.666977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.667470] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.667676] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be created. [ 1091.726178] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.726178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.726178] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.726797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.726797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.729648] env[66131]: INFO networking_nsxv3.common.synchronization [None req-87ddefd6-d20a-48cb-b310-1a50a376a0bf tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_rules [ 1091.730237] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_rules [ 1091.730567] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.730690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.730756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.731032] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.731135] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.744333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1091.852917] env[66131]: INFO networking_nsxv3.common.synchronization [None req-cf468bcb-cdb8-4c94-b1b7-38a2feabf578 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_rules [ 1091.854507] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_rules [ 1091.855051] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.855210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.859962] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd in Status: SUCCESS [ 1091.860191] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd deletion is rescheduled due to dependency. [ 1091.860332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.256185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.256340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.256382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.256599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.256684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.256774] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e already deleted. [ 1092.256854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.257064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.257159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.257234] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.781619] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.782052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.782052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.782195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.782311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.782440] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e already deleted. [ 1092.782559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.762062] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1093.762242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.857618] env[66131]: INFO networking_nsxv3.common.synchronization [req-1b373a3b-4f5c-4835-8d76-aa269d866172 req-ca18bfb1-0b44-488b-8f6e-596b2eef74b3 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1095.860428] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1095.860428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.860428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.860428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.860428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.862400] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.862544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.862609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.862818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.862911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.863028] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.366039] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.585062] env[66131]: INFO networking_nsxv3.common.synchronization [req-01358dbd-cca9-46b4-b486-37c791242d08 req-7c72ff70-b662-4626-8e7f-223aeb3b4d57 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1096.585676] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1096.586014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.586126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.586257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.586410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.586583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.586786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.586906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.586977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.587073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.587203] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.868575] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.089883] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.090144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.090222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.090442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.090533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.090731] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.090827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.090884] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.091073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.091163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.091311] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1097.153896] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.154116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.154159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.154451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.154691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.173266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1097.197372] env[66131]: INFO networking_nsxv3.common.synchronization [None req-6c8f13d2-4835-4086-bccc-796ed871d1c9 None None] Enqueued Resource ID: 54760f15-5171-486b-8fc5-7e44fa698e72 with Priority: HIGHEST for action port [ 1097.197913] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54760f15-5171-486b-8fc5-7e44fa698e72 with Priority: HIGHEST for action port [ 1097.198689] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-54760f15-5171-486b-8fc5-7e44fa698e72 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.198689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54760f15-5171-486b-8fc5-7e44fa698e72" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.198689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54760f15-5171-486b-8fc5-7e44fa698e72" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.198689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54760f15-5171-486b-8fc5-7e44fa698e72" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.198884] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54760f15-5171-486b-8fc5-7e44fa698e72',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.371598] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.371797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.371838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.372063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.372162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.372262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1097.403390] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.403722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.405068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.405068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.405068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.415620] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1097.700690] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54760f15-5171-486b-8fc5-7e44fa698e72 [ 1097.700925] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.701073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.701146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.701360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.701450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.701580] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54760f15-5171-486b-8fc5-7e44fa698e72 already deleted. [ 1097.701621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54760f15-5171-486b-8fc5-7e44fa698e72" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.850770] env[66131]: INFO networking_nsxv3.common.synchronization [None req-4ac98624-100b-4c91-a654-2f724ea649b8 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_rules [ 1097.851780] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_rules [ 1097.852179] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.852340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.852435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.852889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.852889] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.942035] env[66131]: INFO networking_nsxv3.common.synchronization [None req-289d3ebf-8a73-43c7-b55b-92e194acca38 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_rules [ 1097.942035] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_rules [ 1097.942833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.943082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.378066] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.378222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.378295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.378511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.378602] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.378697] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd already deleted. [ 1098.378781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.378931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.379115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.379540] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.768820] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc6e82ab-3dac-459f-beb5-6be3675dd171 req-8a449725-78de-41a1-ad05-e1e961a826c6 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_members [ 1098.771023] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_members [ 1098.771023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.771023] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.771023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.771023] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.900746] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.901651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.901844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.902731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.902915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.903110] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd already deleted. [ 1098.903275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.140388] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-402 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.140734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.140734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.140953] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.141216] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.141375] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.141491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.141702] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.141844] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.142060] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.142170] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.142276] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.142383] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.142492] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.142597] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.142723] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.162405] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.162581] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.162715] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.162887] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.163207] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-68d3c166-f667-436c-93d2-d6dde9421a7a taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.163370] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.163714] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.164173] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.164173] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d3c166-f667-436c-93d2-d6dde9421a7a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.183270] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1099.183270] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1099.183270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.273439] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.273689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.273689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.273916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.274081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.274217] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.274318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.274381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.274530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.274637] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.274690] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e already deleted. [ 1099.274764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.425930] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1099.426167] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.666750] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.667048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.667189] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.667747] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.667747] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.667896] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 68d3c166-f667-436c-93d2-d6dde9421a7a not found, creating... [ 1099.668250] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.668442] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.668529] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.668778] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.668970] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.669291] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.669466] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.669600] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.669857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.670031] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.670207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 68d3c166-f667-436c-93d2-d6dde9421a7a is going to be created. [ 1099.692034] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.692034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.692034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.692368] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.692639] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.693270] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.916238] env[66131]: INFO networking_nsxv3.common.synchronization [None req-83fe7f8d-cfad-4728-b6b2-23dcd1149b67 None None] Enqueued Resource ID: 7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b with Priority: HIGHEST for action port [ 1099.916831] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b with Priority: HIGHEST for action port [ 1099.917320] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.917418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.917479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.917816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.917955] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.403473] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc6e82ab-3dac-459f-beb5-6be3675dd171 req-0ea2d41a-8d76-42fe-b30b-8b9233f44c5c service nova] Enqueued Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_rules [ 1100.405037] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc6e82ab-3dac-459f-beb5-6be3675dd171 req-0ea2d41a-8d76-42fe-b30b-8b9233f44c5c service nova] Enqueued Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_members [ 1100.405037] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc6e82ab-3dac-459f-beb5-6be3675dd171 req-0ea2d41a-8d76-42fe-b30b-8b9233f44c5c service nova] Enqueued Resource ID: 68d3c166-f667-436c-93d2-d6dde9421a7a with Priority: HIGHEST for action port [ 1100.405344] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_rules [ 1100.405672] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_members [ 1100.405871] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68d3c166-f667-436c-93d2-d6dde9421a7a with Priority: HIGHEST for action port [ 1100.406395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.406647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.407361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.407361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.407361] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.408317] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.408579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.408779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.409854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.409854] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.409854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.409854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.409854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.409854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.409854] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.413105] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-68d3c166-f667-436c-93d2-d6dde9421a7a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.413105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.413105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.413105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.413105] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d3c166-f667-436c-93d2-d6dde9421a7a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.420830] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b [ 1100.420830] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.420830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.420830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.420830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.420830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.420830] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b already deleted. [ 1100.420830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f1798c1-0cef-4fc8-bbd8-4bfa4ee2e34b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.913656] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.916692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.916692] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68d3c166-f667-436c-93d2-d6dde9421a7a with status ACTIVE [ 1100.916692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.916692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.916692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.916692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.917471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.917471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.917471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.917471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.917471] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68d3c166-f667-436c-93d2-d6dde9421a7a is going to be updated. [ 1100.939310] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.939310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.939310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.939310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.939310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.939310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68d3c166-f667-436c-93d2-d6dde9421a7a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.418927] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.921578] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.921761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.921831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.922079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.922244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.922294] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e is going to be created. [ 1101.950324] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.950516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.950555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.950730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.950895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.967718] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e in Status: UNINITIALIZED for 2s [ 1102.630360] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.630737] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.630737] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.631146] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.631645] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.631743] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.631821] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.632075] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.632233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.632448] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.632568] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.632897] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.632897] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.632998] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.633680] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.633680] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.653030] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.653030] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.653030] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.653030] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-156" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.653342] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-02cf995f-5b39-4612-9010-ab9060fca3e4 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.653534] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.653658] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.653920] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.654071] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02cf995f-5b39-4612-9010-ab9060fca3e4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.156632] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.156875] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.157017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.157321] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.157472] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.157894] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.158099] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.158225] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.158444] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.158582] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.158868] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.159041] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.159161] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.159364] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.159495] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.159645] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 is going to be updated. [ 1103.180315] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.180532] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.180658] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.180958] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.181203] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.181530] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.802137] env[66131]: INFO networking_nsxv3.common.synchronization [req-b8c8dce5-3320-4dff-88e7-324d4e90e887 req-b7c41bc9-bffa-4144-87bb-0ede2e289715 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_members [ 1103.803252] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_members [ 1103.803646] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.803777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.803846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.804122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.804275] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.804376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.804437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.804587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.804748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.804849] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.897623] env[66131]: INFO networking_nsxv3.common.synchronization [req-f75a203b-8373-4350-93a3-cb2c693c04af req-78446b7b-049a-4bf0-bdbb-15f69bf041be service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 1103.897841] env[66131]: INFO networking_nsxv3.common.synchronization [req-f75a203b-8373-4350-93a3-cb2c693c04af req-78446b7b-049a-4bf0-bdbb-15f69bf041be service nova] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1103.897998] env[66131]: INFO networking_nsxv3.common.synchronization [req-f75a203b-8373-4350-93a3-cb2c693c04af req-78446b7b-049a-4bf0-bdbb-15f69bf041be service nova] Enqueued Resource ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 with Priority: HIGHEST for action port [ 1103.898768] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_rules [ 1103.898910] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1103.899025] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 with Priority: HIGHEST for action port [ 1103.900031] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.900031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.900031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.900031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.900031] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.901065] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.901185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.901400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.901574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.901726] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.901823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.901886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.902042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.902147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.902234] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.903104] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-02cf995f-5b39-4612-9010-ab9060fca3e4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.903259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.903359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.903485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.903581] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02cf995f-5b39-4612-9010-ab9060fca3e4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.979200] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e in Status: SUCCESS [ 1103.979200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.979200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.979403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.980551] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.980551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.980551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.980551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.980551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.980551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.980551] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.144000] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.144267] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.144446] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.144728] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.145077] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.145170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.145586] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.145586] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.145687] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.145850] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.145958] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.146076] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.146181] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.146325] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.146819] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.146819] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.165046] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.165046] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.165046] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.165215] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.165485] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-9ead9892-c583-4a2d-a3d8-f61b5147688d taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.165703] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.165827] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.166183] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.166345] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ead9892-c583-4a2d-a3d8-f61b5147688d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.307476] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.307743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.307743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.307928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.308035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.308258] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.308372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.308428] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.308595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.308675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.308764] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd already deleted. [ 1104.308847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.406147] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.406296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.406499] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.407718] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02cf995f-5b39-4612-9010-ab9060fca3e4 with status ACTIVE [ 1104.407918] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.408050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.408116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.408323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.408413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.408579] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.408675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.408744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.409951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.409951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.409951] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.409951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.409951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.409951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.409951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.409951] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02cf995f-5b39-4612-9010-ab9060fca3e4 is going to be updated. [ 1104.433923] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.434154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.434197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.434429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.434577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.434742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02cf995f-5b39-4612-9010-ab9060fca3e4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.484009] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.669459] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.669967] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.670198] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.670697] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.670914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.671155] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 9ead9892-c583-4a2d-a3d8-f61b5147688d not found, creating... [ 1104.671481] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.671678] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.671894] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.672199] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.672389] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.672762] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.672978] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.673161] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.673470] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.673716] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.673873] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 9ead9892-c583-4a2d-a3d8-f61b5147688d is going to be created. [ 1104.696889] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.697195] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.697333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.697633] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.697995] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.698374] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.911778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.987051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d7d6455-8f79-4497-9ae4-0a26ac23c21e: rpc.has_security_group_logging(os_id): False [ 1105.005297] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.005454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.005517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.005760] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.005972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.006170] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.006290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.006358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.006518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.006615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.006710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e is going to be created. [ 1105.065839] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.066052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.066052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.066242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.066420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.080048] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e in Status: IN_PROGRESS for 2s [ 1105.400177] env[66131]: INFO networking_nsxv3.common.synchronization [req-b8c8dce5-3320-4dff-88e7-324d4e90e887 req-2d3a3937-aefd-45d7-bcac-79b23793ea89 service nova] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_rules [ 1105.400472] env[66131]: INFO networking_nsxv3.common.synchronization [req-b8c8dce5-3320-4dff-88e7-324d4e90e887 req-2d3a3937-aefd-45d7-bcac-79b23793ea89 service nova] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_members [ 1105.400728] env[66131]: INFO networking_nsxv3.common.synchronization [req-b8c8dce5-3320-4dff-88e7-324d4e90e887 req-2d3a3937-aefd-45d7-bcac-79b23793ea89 service nova] Enqueued Resource ID: 9ead9892-c583-4a2d-a3d8-f61b5147688d with Priority: HIGHEST for action port [ 1105.401440] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_rules [ 1105.401694] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_members [ 1105.401892] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ead9892-c583-4a2d-a3d8-f61b5147688d with Priority: HIGHEST for action port [ 1105.404256] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.404386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.404456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.404659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.404742] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.405691] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.405860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.405963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.406354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.406762] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.406762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.406978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.406978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.407078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.407175] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.408093] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ead9892-c583-4a2d-a3d8-f61b5147688d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.408207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.408326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.408663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.408701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ead9892-c583-4a2d-a3d8-f61b5147688d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.413653] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.413805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.413874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.414080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.414170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.414263] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 1105.446428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.446628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.446725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.446986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.447221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.457560] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1105.911246] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.912740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.913120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.913120] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ead9892-c583-4a2d-a3d8-f61b5147688d with status ACTIVE [ 1105.913236] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.913319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.913996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.913996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.913996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.913996] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.914213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.914289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.915035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.915035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.915035] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.915328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.915328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.915587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.915753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.915933] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ead9892-c583-4a2d-a3d8-f61b5147688d is going to be updated. [ 1105.941595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.941844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.941844] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.942024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.942168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.942341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ead9892-c583-4a2d-a3d8-f61b5147688d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.103218] env[66131]: INFO networking_nsxv3.common.synchronization [req-cab00ffb-279a-40f9-a034-bf321f58fe0b req-14e0dfe9-b2af-4eb2-a2dd-f2354b2e2c21 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1106.104112] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1106.104610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.104810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.105202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.105252] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.105506] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.105776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.105840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.106072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.106214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.106359] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.418466] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.464882] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.465243] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.465454] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.465913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.466366] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.466630] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.466828] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.467111] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.467925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.467925] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.467925] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.467925] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.467925] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.468188] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.468349] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.468667] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.500434] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.500681] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.500851] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.501350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.501667] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-50f517ed-bb34-4a39-8049-ac837f497f02 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.501857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.501979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.502393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.504758] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f517ed-bb34-4a39-8049-ac837f497f02',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.609567] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.609812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.609914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.610253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.610399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.610768] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.610855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.610935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.611188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.611315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.611446] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1106.650549] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.650809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.650913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.651300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.651535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.663177] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1106.922636] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.922975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.922975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.923233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.923333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.923541] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd is going to be created. [ 1106.953071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.953355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.953355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.953526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.953708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.964452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd in Status: UNINITIALIZED for 2s [ 1107.007017] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.007259] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.007401] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.007694] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.007882] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.008099] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 50f517ed-bb34-4a39-8049-ac837f497f02 not found, creating... [ 1107.008409] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.008560] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.008677] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.008909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.009076] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.009401] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.009587] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.009709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.009924] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.010069] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.010209] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 50f517ed-bb34-4a39-8049-ac837f497f02 is going to be created. [ 1107.034153] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.034534] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.034739] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.035082] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.035325] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.035580] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.097206] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e in Status: SUCCESS [ 1107.097467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.572773] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1107.573089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.573190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.573552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.573701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.573701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.573796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.573979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.573979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.574077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.574235] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.748443] env[66131]: INFO networking_nsxv3.common.synchronization [req-cab00ffb-279a-40f9-a034-bf321f58fe0b req-3e7bf990-0b87-44b5-8c15-25850854ed57 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1107.748682] env[66131]: INFO networking_nsxv3.common.synchronization [req-cab00ffb-279a-40f9-a034-bf321f58fe0b req-3e7bf990-0b87-44b5-8c15-25850854ed57 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1107.748815] env[66131]: INFO networking_nsxv3.common.synchronization [req-cab00ffb-279a-40f9-a034-bf321f58fe0b req-3e7bf990-0b87-44b5-8c15-25850854ed57 service nova] Enqueued Resource ID: 50f517ed-bb34-4a39-8049-ac837f497f02 with Priority: HIGHEST for action port [ 1107.749453] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1107.749599] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1107.749721] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f517ed-bb34-4a39-8049-ac837f497f02 with Priority: HIGHEST for action port [ 1107.750014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.750154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.750221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.750414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.750497] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.751357] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.751440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.752029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f517ed-bb34-4a39-8049-ac837f497f02 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.752029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.752029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.752029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.752374] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f517ed-bb34-4a39-8049-ac837f497f02',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.076015] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.076387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.076387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.076460] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.076618] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.076731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.076813] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.076977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.077082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.077177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.077323] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.077417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.077481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.077622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.077763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.077854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.077913] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.078068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.078146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.078232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.078325] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.253676] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.253848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.255236] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50f517ed-bb34-4a39-8049-ac837f497f02 with status ACTIVE [ 1108.255435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.255575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.255724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.255950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.256055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.256240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.256368] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.256406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.256600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.256648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.256938] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.257054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.257172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.257266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.257343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.257430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50f517ed-bb34-4a39-8049-ac837f497f02 is going to be updated. [ 1108.306857] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.307052] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.307093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.307423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.307423] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.307607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f517ed-bb34-4a39-8049-ac837f497f02" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.496024] env[66131]: INFO networking_nsxv3.common.synchronization [req-22ea0dd6-1989-45bd-a6e9-91cb75229b0f req-2fd568af-982d-4602-b52f-f7a5182125f0 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1108.497224] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1108.497224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.497224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.497224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.497224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.497410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.497410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.497519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.498211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.498211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.498211] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.580323] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3951e5e1-7963-4597-8681-5924c72de16e: rpc.has_security_group_logging(os_id): False [ 1108.598063] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.598243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.598284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.598502] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.598593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.598809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.598952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.598998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.599126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.599203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.599400] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.599495] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.599593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.599692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.599769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.599993] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.600118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.600166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.600322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.600397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.600507] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 1108.660534] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.660719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.660767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.661095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.661095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.673341] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1108.673341] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1108.673341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.673601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.674046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.674046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.674046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.674046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.674262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.674295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.674418] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.679752] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1108.975395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd in Status: SUCCESS [ 1108.975847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.976073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.976308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.976513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.976656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.976732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.976950] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.977045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.977137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.977231] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.999451] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.051226] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.053276] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.053489] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.054421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.054768] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.054980] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.055146] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.057498] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.057660] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.057878] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.057997] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.058128] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.058237] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.058348] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.058454] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.058585] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.079565] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.079983] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.079983] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.080052] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.080372] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-9659868f-982c-4006-bccb-305bf42d0c85 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.080544] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.080663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.081019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.081154] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9659868f-982c-4006-bccb-305bf42d0c85',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.177041] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.480765] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.501532] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.583277] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.583526] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.583714] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.584022] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.585182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.585182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 9659868f-982c-4006-bccb-305bf42d0c85 not found, creating... [ 1109.585182] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.585182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.585182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.585182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.585182] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.585485] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.585663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.585781] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.586013] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.586635] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.586857] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 9659868f-982c-4006-bccb-305bf42d0c85 is going to be created. [ 1109.608151] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.609351] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.609351] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.609351] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.609351] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.609686] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.681497] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.982885] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c23c566c-2b2f-4799-89b7-6a402d4e19dd: rpc.has_security_group_logging(os_id): False [ 1110.003191] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.003407] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.003499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.003676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.003771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.004105] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.004211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.004280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.004458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.004626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.004724] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd is going to be created. [ 1110.006122] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.006291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.006348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.006506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.006588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.006675] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1110.038523] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.038685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.038752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.039715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.039715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.049443] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1110.071171] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.071331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.071835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.071835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.071835] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.083008] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd in Status: IN_PROGRESS for 2s [ 1110.184705] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.184873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.184932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.185203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.185300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.185400] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1110.218921] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.219111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.219161] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.219372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.219517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.227766] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1110.334740] env[66131]: INFO networking_nsxv3.common.synchronization [req-22ea0dd6-1989-45bd-a6e9-91cb75229b0f req-420fe548-ce40-4b97-acfd-88fba71d7da2 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1110.335099] env[66131]: INFO networking_nsxv3.common.synchronization [req-22ea0dd6-1989-45bd-a6e9-91cb75229b0f req-420fe548-ce40-4b97-acfd-88fba71d7da2 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1110.335347] env[66131]: INFO networking_nsxv3.common.synchronization [req-22ea0dd6-1989-45bd-a6e9-91cb75229b0f req-420fe548-ce40-4b97-acfd-88fba71d7da2 service nova] Enqueued Resource ID: 9659868f-982c-4006-bccb-305bf42d0c85 with Priority: HIGHEST for action port [ 1110.336131] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1110.336338] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1110.336511] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9659868f-982c-4006-bccb-305bf42d0c85 with Priority: HIGHEST for action port [ 1110.336925] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.337138] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.337267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.337524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.337615] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.338626] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.338791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.339141] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-9659868f-982c-4006-bccb-305bf42d0c85 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.339326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.339445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.339736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.339885] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9659868f-982c-4006-bccb-305bf42d0c85',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.699131] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1110.699374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.841626] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.841867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.842241] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9659868f-982c-4006-bccb-305bf42d0c85 with status ACTIVE [ 1110.842241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.842411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.842411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.842569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.843480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.843749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.843855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.843855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.844150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.844202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.844395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.844520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.844662] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.844752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.844865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.844979] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9659868f-982c-4006-bccb-305bf42d0c85 is going to be updated. [ 1110.866292] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.866469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.866512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.866757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.866905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.867101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9659868f-982c-4006-bccb-305bf42d0c85" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.059527] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1112.059858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.059858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.060053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.060242] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.060358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.060422] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.060571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.060654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.060751] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.095711] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd in Status: SUCCESS [ 1112.096270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.238203] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 4s [ 1112.563473] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.067009] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.569495] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.569728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.569827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.570064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.570201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.570313] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1113.602658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.602871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.602871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.603118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.603263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.612073] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1114.251051] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1114.251051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.251051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.251051] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.251051] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.251550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.251550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.251550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.251550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.251550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.251730] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.755098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.755320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.755391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.755606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.755857] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.756014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.756090] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.756253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.756341] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.756425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.756574] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.756713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.756713] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.756878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.756994] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.757097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.757163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.757281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.757361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.757485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.757539] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.260161] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95303b6-7e26-444d-bfa3-5518dbc80e21: rpc.has_security_group_logging(os_id): False [ 1115.281046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.281202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.281293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.281666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.281793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.281964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.282088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.282140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.282638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.282748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.282914] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.283017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.283077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.283227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.283452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.283536] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.283608] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.283640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.283799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.283865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.283952] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1115.337556] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1115.337708] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1115.356465] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.356714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.356849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.357129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.357334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.378976] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1115.624061] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1115.624218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.624313] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.624539] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.624729] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.624847] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.624911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.625074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.625157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.625256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.625356] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.127657] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.127882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.127882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.128149] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.128322] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.128427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.128493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.128647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.128737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.128853] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.129068] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.129169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.129361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.129607] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.129816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.129974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.130099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.130299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.130427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.130625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.130826] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.633340] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1116.659637] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.659830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.659878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.660123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.660210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.660413] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.660706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.660706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.660706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.660798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.661021] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.661123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.661187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.661340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.661415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.661602] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.661693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.661755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.661892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.661966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.662130] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1116.736081] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.736342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.736438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.736852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.737024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.756683] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1117.398130] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1117.398451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.773755] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1118.774046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.802311] env[66131]: INFO networking_nsxv3.common.synchronization [req-d70631ef-c9be-4784-a887-9564e0ba026c req-ac9d07b5-ca5c-4ed4-a98a-3b354a43235a tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1118.802886] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1118.803235] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.803354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.803421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.803629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.803846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.803961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.804107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.804323] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.804414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.804537] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.309606] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.812389] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.315135] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.315334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.315414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.315641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.315720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.315853] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be updated. [ 1120.346255] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.346459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.346556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.346833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.347056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.357832] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: IN_PROGRESS for 2s [ 1121.894959] env[66131]: INFO networking_nsxv3.common.synchronization [req-c387d33a-4029-4b62-9006-cf210b32c473 req-2af6fa84-67d2-4b2c-8aea-de45984a5e61 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1121.895501] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1121.895848] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.895979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.896061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.896257] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.896417] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.896514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.896576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.896871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.896871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.896967] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.370048] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1122.370299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.399016] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.399248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.399327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.399550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.399642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.399968] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.399968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.400127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.400254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.400288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.400368] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1122.427353] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.427353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.427353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.427551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.427677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.443654] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1124.454566] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1124.455080] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1124.455080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.271126] env[66131]: INFO networking_nsxv3.common.synchronization [req-63026c50-61ff-4f28-9b7f-c18d75b36c5f req-835d1e33-e725-4a29-bbe4-9a1b94e8a2ca tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1125.271834] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 with Priority: HIGHEST for action security_group_members [ 1125.272075] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-6270fe51-9cd9-43e6-84a8-7fa928433147 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.273869] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.273869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.273869] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6270fe51-9cd9-43e6-84a8-7fa928433147',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.389359] env[66131]: INFO networking_nsxv3.common.synchronization [req-2b85c114-e7a0-45a4-a9a5-0ea13ab67d14 req-48934ed8-e801-4f78-884f-dc21485d7f19 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1125.389870] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1125.390185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.390303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.390371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.390562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.390711] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.391166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.391240] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.391409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.391499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.391593] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.737208] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.737546] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.737546] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.737791] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.738054] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.738216] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.738407] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.738557] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.738701] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.738905] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.739195] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.739195] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.739291] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.739352] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.739466] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.739636] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.768680] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.768940] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.769063] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.769405] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.769782] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-fe806587-f1fe-41a8-a4da-887e03dd9350 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.770017] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.770171] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.770552] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.770708] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe806587-f1fe-41a8-a4da-887e03dd9350',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.775192] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.775334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.775405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.775609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.775705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.775967] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.776101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.776180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.776327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.776505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.776611] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 is going to be updated. [ 1125.806289] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.806516] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.807350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.807609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.807834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.819589] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: IN_PROGRESS for 2s [ 1125.892978] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.273020] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.273285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.273411] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.273704] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.273861] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.274031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port fe806587-f1fe-41a8-a4da-887e03dd9350 not found, creating... [ 1126.274303] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.274461] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.274579] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.274799] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.274938] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.275328] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.275489] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.275605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.275810] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.276023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.276170] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: fe806587-f1fe-41a8-a4da-887e03dd9350 is going to be created. [ 1126.296806] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.297153] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.297334] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.297678] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.298046] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.298402] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.395484] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.897720] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.898049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.898049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.900888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.900888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.900888] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1126.927298] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.927916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.928453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.928453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.928556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.943243] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1126.986865] env[66131]: INFO networking_nsxv3.common.synchronization [req-2b85c114-e7a0-45a4-a9a5-0ea13ab67d14 req-ae14f06b-6aa3-40c1-b23f-46a6f1a2955e service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1126.987033] env[66131]: INFO networking_nsxv3.common.synchronization [req-2b85c114-e7a0-45a4-a9a5-0ea13ab67d14 req-ae14f06b-6aa3-40c1-b23f-46a6f1a2955e service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1126.987177] env[66131]: INFO networking_nsxv3.common.synchronization [req-2b85c114-e7a0-45a4-a9a5-0ea13ab67d14 req-ae14f06b-6aa3-40c1-b23f-46a6f1a2955e service nova] Enqueued Resource ID: fe806587-f1fe-41a8-a4da-887e03dd9350 with Priority: HIGHEST for action port [ 1126.987741] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1126.987951] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1126.988064] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe806587-f1fe-41a8-a4da-887e03dd9350 with Priority: HIGHEST for action port [ 1126.988332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.988827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.988827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.988827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.988827] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.991373] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.991373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.991373] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe806587-f1fe-41a8-a4da-887e03dd9350 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.991373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.991373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.991373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.991373] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe806587-f1fe-41a8-a4da-887e03dd9350',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.493519] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.493648] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.495009] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe806587-f1fe-41a8-a4da-887e03dd9350 with status ACTIVE [ 1127.495139] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.495250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.495327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.495520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.495606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.495771] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.495911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.495965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.496134] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.496212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.496389] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.496483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.496544] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.496677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.496752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.496917] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe806587-f1fe-41a8-a4da-887e03dd9350 is going to be updated. [ 1127.518185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.518335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.518406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.518601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.518738] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.518983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe806587-f1fe-41a8-a4da-887e03dd9350" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.828808] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 in Status: SUCCESS [ 1127.828808] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6270fe51-9cd9-43e6-84a8-7fa928433147 deletion is rescheduled due to dependency. [ 1127.828916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6270fe51-9cd9-43e6-84a8-7fa928433147" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.954345] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1128.954801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.954801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.955014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.955204] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.955318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.955375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.955521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.955599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.955692] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.460621] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.762341] env[66131]: INFO networking_nsxv3.common.synchronization [None req-4653a236-bae6-4239-af34-665ddb6bf3ac tempest-AttachInterfacesTestJSON-1641212069 tempest-AttachInterfacesTestJSON-1641212069-project-member] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1129.762394] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGHEST for action security_group_members [ 1129.762670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.763061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.763061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.763500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.763731] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.763954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.764116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.764346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.764481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.764611] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.962812] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.267665] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.267801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.267801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.268046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.268150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.268381] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.268485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.268549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.268707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.268800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.268871] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be updated. [ 1130.299262] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.299482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.299574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.299856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.299972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.308852] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: IN_PROGRESS for 2s [ 1130.465665] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.465955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.466072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.466296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.466392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.466495] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1130.497071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.497271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.497325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.497506] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.497660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.506614] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1132.318452] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3951e5e1-7963-4597-8681-5924c72de16e in Status: SUCCESS [ 1132.318830] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3951e5e1-7963-4597-8681-5924c72de16e deletion is rescheduled due to dependency. [ 1132.318830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.516742] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1132.516992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.517177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.517393] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.517602] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.517725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.517781] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.517934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.518030] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.518119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.518209] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.020878] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.021053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.021120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.021340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.021750] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.021750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.021750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.021957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.021957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.021957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.022149] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.022192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.022255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.022374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.022510] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.022600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.022658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.022785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.022859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.022939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.023037] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.066842] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2822025f-0183-43af-8783-772f35821f21 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_rules [ 1133.067489] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_rules [ 1133.067816] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.067959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.068046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.068361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.068445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.151643] env[66131]: INFO networking_nsxv3.common.synchronization [None req-40dc21c7-f55f-49ce-9ab0-a73fb876833e tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_rules [ 1133.151844] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_rules [ 1133.152217] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.152547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.526314] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1133.551596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.551780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.551862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.552105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.552253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.552440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.552548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.552599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.552752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.552857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.553120] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.553224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.553290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.553434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.553512] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.553749] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.553832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.553903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.554060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.554238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.554786] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1133.595960] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.596231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.596329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.596585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.596674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.596813] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a already deleted. [ 1133.596952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.597248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.597554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.597554] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.638116] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.638318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.638363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.638667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.638885] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.656366] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1134.121690] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.121905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.121905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.122064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.122164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.122360] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a already deleted. [ 1134.122496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.790577] env[66131]: INFO networking_nsxv3.common.synchronization [req-7da0cd8a-341e-459b-91cb-0f6b0db7ee11 req-d86b617b-9d3b-48d0-b4c3-333b3d81f695 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1134.790808] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1134.791719] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.791865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.791925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.792140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.792471] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.792582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.792652] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.792816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.792903] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.792998] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.107765] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.107958] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.108095] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.108375] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.108620] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.108778] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.108911] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.109677] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.109854] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.110184] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.110392] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.110514] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.110627] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.110744] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.110852] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.110984] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.134077] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.134274] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.134381] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.134567] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.134879] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.135132] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.135198] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.135491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.135629] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58d3d11f-aabc-4acb-ba68-9e8de8aeffe7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.295503] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.296025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.296025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.296025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.296150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.296303] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.296397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.296446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.296586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.296664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.296750] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1135.323937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.323937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.323937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.323937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.323937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.335670] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1135.526253] env[66131]: INFO networking_nsxv3.common.synchronization [req-40fb1312-c37c-49ff-906c-5bb1619edd2b req-6c626750-47fe-4204-aff8-15ab30920a14 tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_members [ 1135.526705] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGHEST for action security_group_members [ 1135.527488] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.527488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.527488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.527488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.527673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.527673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.527814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.527854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.528112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.528112] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.753787] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.754124] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.755372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.755372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.755372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.755372] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 not found, creating... [ 1135.755372] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.755372] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.755699] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.756204] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.756204] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.756568] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.756766] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.756817] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.757069] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.757253] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.757430] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 is going to be created. [ 1135.778717] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1135.778945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.782435] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.782638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.782771] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.783044] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.783270] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.783544] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.031538] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.031939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.031939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.032082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.032082] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.032266] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.032399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.032645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.032934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.033070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.033178] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 is going to be updated. [ 1136.065750] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.065865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.065936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.066260] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.066413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.076621] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: IN_PROGRESS for 2s [ 1136.404807] env[66131]: INFO networking_nsxv3.common.synchronization [req-7da0cd8a-341e-459b-91cb-0f6b0db7ee11 req-b3fa5ad4-12e4-45f0-bf01-229881aaf015 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1136.404997] env[66131]: INFO networking_nsxv3.common.synchronization [req-7da0cd8a-341e-459b-91cb-0f6b0db7ee11 req-b3fa5ad4-12e4-45f0-bf01-229881aaf015 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1136.405199] env[66131]: INFO networking_nsxv3.common.synchronization [req-7da0cd8a-341e-459b-91cb-0f6b0db7ee11 req-b3fa5ad4-12e4-45f0-bf01-229881aaf015 service nova] Enqueued Resource ID: 58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 with Priority: HIGHEST for action port [ 1136.405650] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1136.405805] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1136.405877] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 with Priority: HIGHEST for action port [ 1136.406248] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.406384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.406440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.406675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.406705] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.407583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.407680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.407865] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.408022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.408022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.408206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.408291] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58d3d11f-aabc-4acb-ba68-9e8de8aeffe7',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.910864] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.911037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914432] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 with status ACTIVE [ 1136.914626] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.914767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.915062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.915165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.915399] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.915471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.915532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.915682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.915759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.915937] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.916074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.916133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.916271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.916346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.916428] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58d3d11f-aabc-4acb-ba68-9e8de8aeffe7 is going to be updated. [ 1136.939246] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.939401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.939461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.939673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.939814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.939974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58d3d11f-aabc-4acb-ba68-9e8de8aeffe7" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.356532] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1137.356982] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1137.356982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.356982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.357250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.357435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.357548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.357614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.357752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.357831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.357920] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.859851] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.086921] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 in Status: SUCCESS [ 1138.087147] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 deletion is rescheduled due to dependency. [ 1138.087211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.362010] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.708212] env[66131]: INFO networking_nsxv3.common.synchronization [req-cad55784-fc99-4d15-852c-42ca70e71b91 req-82c22fbe-bcbc-4f76-ba0e-91497c638f17 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1138.708325] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1138.708600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.708699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.708757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.709105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.709959] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.709959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.709959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.709959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.709959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.709959] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.864241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.864439] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.864479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.864873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.865015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.865154] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1138.892148] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.892327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.892370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.892560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.892706] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.906161] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1139.212504] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.573701] env[66131]: INFO networking_nsxv3.common.synchronization [req-c5be59cb-8461-4da3-97e8-9b03d6c77ce6 req-bac1878e-91b2-41eb-8ff2-91e6314ccfb3 tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 1139.574388] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 with Priority: HIGHEST for action security_group_members [ 1139.574764] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-635d180a-1a27-4897-8f2c-a14eca9102c1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.574764] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.574764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.574764] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('635d180a-1a27-4897-8f2c-a14eca9102c1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.683258] env[66131]: INFO networking_nsxv3.common.synchronization [req-61a863b3-dc14-4f77-a61c-a3a77b16b802 req-5d99ad8c-f6f2-427a-92b3-b719778c4067 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_members [ 1139.683709] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_members [ 1139.684188] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.684388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.684556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.684882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.685127] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.685283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.685378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.685613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.685744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.685883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.714035] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.019024] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.019024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.019024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.019024] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.019024] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.019595] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.019837] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.020148] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.020393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.020704] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.020919] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.021132] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.021342] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.022050] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.022050] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.022050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.039289] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.039459] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.039589] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.039764] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.040098] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-28d5fde0-be06-4b74-a2df-3060a0f6ad66 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.040286] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.040438] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.040766] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.040901] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28d5fde0-be06-4b74-a2df-3060a0f6ad66',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.078336] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.078535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.078580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.078753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.078845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.079055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.079163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.079224] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.079372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.079448] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.079533] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 is going to be updated. [ 1140.104881] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.105220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.105297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.105517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.105661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.115266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: IN_PROGRESS for 2s [ 1140.188472] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.188668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.188668] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.188891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.188984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.189270] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.189370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.189433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.189591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.189672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.189754] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a already deleted. [ 1140.189832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.216024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.216223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.216311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.216528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.216621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.216738] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1140.247781] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.247936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.248014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.248362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.248513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.258995] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1140.543440] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.543715] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.543825] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.544255] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.544447] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.544643] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 28d5fde0-be06-4b74-a2df-3060a0f6ad66 not found, creating... [ 1140.544984] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.545316] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.545424] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.545686] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.545855] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.546345] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.546559] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.546699] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.546967] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.547213] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.547397] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 28d5fde0-be06-4b74-a2df-3060a0f6ad66 is going to be created. [ 1140.575952] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.576539] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.576539] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.576793] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.577200] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.577391] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.916438] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1140.916593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.916728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.916925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.917138] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.917251] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.917319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.917481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.917565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.917649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.917740] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.297576] env[66131]: INFO networking_nsxv3.common.synchronization [req-61a863b3-dc14-4f77-a61c-a3a77b16b802 req-d8e6f74a-abf4-4682-bdd1-f5cb3aa2248f service nova] Enqueued Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_rules [ 1141.297749] env[66131]: INFO networking_nsxv3.common.synchronization [req-61a863b3-dc14-4f77-a61c-a3a77b16b802 req-d8e6f74a-abf4-4682-bdd1-f5cb3aa2248f service nova] Enqueued Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_members [ 1141.298761] env[66131]: INFO networking_nsxv3.common.synchronization [req-61a863b3-dc14-4f77-a61c-a3a77b16b802 req-d8e6f74a-abf4-4682-bdd1-f5cb3aa2248f service nova] Enqueued Resource ID: 28d5fde0-be06-4b74-a2df-3060a0f6ad66 with Priority: HIGHEST for action port [ 1141.298761] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_rules [ 1141.298761] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_members [ 1141.298761] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28d5fde0-be06-4b74-a2df-3060a0f6ad66 with Priority: HIGHEST for action port [ 1141.299021] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.299142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.299233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.299378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.299456] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.300354] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.300515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.300561] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.300701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.300852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.301567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.301567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.301567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.301567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.301567] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.302330] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-28d5fde0-be06-4b74-a2df-3060a0f6ad66 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.302447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.302447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.302643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.302734] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28d5fde0-be06-4b74-a2df-3060a0f6ad66',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.422017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.422017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.422017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.422017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.422017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.422247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.422247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.422463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.422564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.422673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.422852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.422995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.423107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.423312] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.423506] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.423613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.423718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.423909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.424053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.424166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.424264] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.804920] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.805967] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.806157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.806383] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28d5fde0-be06-4b74-a2df-3060a0f6ad66 with status ACTIVE [ 1141.806566] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.806675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.806764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.806933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.807725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.807725] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.807725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.807725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.807725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.807725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.808011] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.808011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.808011] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.808182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.808182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.808182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28d5fde0-be06-4b74-a2df-3060a0f6ad66 is going to be updated. [ 1141.828699] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.828901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.829017] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.829253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.829395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.829560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28d5fde0-be06-4b74-a2df-3060a0f6ad66" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.930139] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95303b6-7e26-444d-bfa3-5518dbc80e21: rpc.has_security_group_logging(os_id): False [ 1141.949861] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.950062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.950110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.950308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.950472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.950700] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.951103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.951103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.951103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.951250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.951318] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.951414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.951476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.951616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.951693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.951892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.952021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.952078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.952197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.952274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.952359] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1142.039192] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.039282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.039965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.039965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.039965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.063788] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1142.130387] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 in Status: SUCCESS [ 1142.130610] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 635d180a-1a27-4897-8f2c-a14eca9102c1 deletion is rescheduled due to dependency. [ 1142.130732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-635d180a-1a27-4897-8f2c-a14eca9102c1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.270531] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1142.270785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.310334] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.812665] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.812665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.812665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.813199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.813199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.813199] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a is going to be created. [ 1142.837552] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.837728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.837728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.837931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.838107] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.849509] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a in Status: UNINITIALIZED for 2s [ 1144.082047] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1144.082355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.859590] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a in Status: SUCCESS [ 1144.859820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.859987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.860228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.860426] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.860548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.860613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.860761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.860843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.860933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.861027] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.362957] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.700380] env[66131]: INFO networking_nsxv3.common.synchronization [None req-98f9d329-7e77-4485-992b-2b77c9c9eeef tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1145.700380] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1145.700652] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.700769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.700834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.701675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.702413] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.800547] env[66131]: INFO networking_nsxv3.common.synchronization [None req-3408dc09-5dde-4c61-b0ef-96b286600f31 tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1145.800547] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1145.800547] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.800547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.865649] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b77736a7-a5de-40ee-af04-cb5c681cfc4a: rpc.has_security_group_logging(os_id): False [ 1145.888714] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.888867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.888942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.889236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.889286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.889593] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.889712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.889712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.889833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.889911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.889998] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a is going to be created. [ 1145.949452] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.949650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.949770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.950137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.950412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.961971] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a in Status: IN_PROGRESS for 2s [ 1146.223927] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.224140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.224212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.224426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.224515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.224614] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f already deleted. [ 1146.224697] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.224850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.225016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.225102] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.751692] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.752208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.752208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.752208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.752345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.752345] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f already deleted. [ 1146.752424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.926574] env[66131]: INFO networking_nsxv3.common.synchronization [req-fcc11353-5641-456d-8228-97364052eb3c req-0bf2aa41-a3ee-4bc9-b8c5-d0bd2e6677d2 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1146.926844] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1146.927313] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.927442] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.927486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.927690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.927846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.927945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.928016] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.928786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.933022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.933022] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.435605] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.938779] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.973739] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a in Status: SUCCESS [ 1147.974031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.317869] env[66131]: INFO networking_nsxv3.common.synchronization [req-eb6834d2-115a-4f84-a37a-94ba3de74a43 req-831bccb9-299e-446c-b033-7e2443c46c99 tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 1148.319077] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 1148.321600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.321600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.321600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.321600] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.406277] env[66131]: INFO networking_nsxv3.common.synchronization [req-b6161d78-9819-4692-9cc8-848f4272bccf req-09eba136-2289-4445-a79f-be5bc3dc4eaf tempest-ServersV294TestFqdnHostnames-31794505 tempest-ServersV294TestFqdnHostnames-31794505-project-member] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_members [ 1148.406914] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGHEST for action security_group_members [ 1148.407542] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.407661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.407779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.408014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.408154] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.408277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.408332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.408530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.408677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.408729] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.440861] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.443150] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.443320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.443576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.443676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.443791] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1148.479026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.479026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.479026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.479026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.479026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.489317] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1148.823136] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.910838] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.911037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.911143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.911370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.911467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.911750] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.911900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.911995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.912233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.912344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.912459] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 is going to be updated. [ 1148.951536] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.952080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.952080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.952080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.952241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.966008] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: IN_PROGRESS for 2s [ 1149.326603] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.828819] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.829054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.829173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.829514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.829677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.829860] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be updated. [ 1149.862342] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.862487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.862487] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.862707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.862852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.872964] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: IN_PROGRESS for 2s [ 1150.351128] env[66131]: INFO networking_nsxv3.common.synchronization [req-81997599-1b99-4aa5-be14-036d4ad0d670 req-8f353f5c-3190-4400-975f-b496b69ba0bc tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_members [ 1150.351667] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e with Priority: HIGHEST for action security_group_members [ 1150.352172] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.352936] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.353018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.353226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.353420] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.353531] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.353595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.353755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.353841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.353938] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d7d6455-8f79-4497-9ae4-0a26ac23c21e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.500507] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1150.501056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.769101] env[66131]: INFO networking_nsxv3.common.synchronization [req-f23a06d5-1d0e-4f43-a1de-6e5c74c544ca req-955a2a2f-14d1-43ac-9739-78b691778366 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1150.769696] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1150.770028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.771144] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.771144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.771144] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.855554] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.855690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.855690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.855886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.855981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.856263] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.856404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.856404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.856556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.856628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.856713] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e is going to be updated. [ 1150.884116] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.884283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.884343] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.884559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.884702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.895359] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e in Status: IN_PROGRESS for 2s [ 1150.976180] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 in Status: SUCCESS [ 1150.976496] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 deletion is rescheduled due to dependency. [ 1150.976496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.276569] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.276724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.276724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.276896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.276995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.277249] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.277355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.277419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.277624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.278503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.278503] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1151.326111] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.326783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.326783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.326783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.326783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.341243] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1151.527156] env[66131]: INFO networking_nsxv3.common.synchronization [req-32263ef3-1f94-44d6-af30-cc43526cf377 req-6eab8165-bec4-4e55-a0ae-d2f8a19125be tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1151.527880] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1151.532600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.532600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.532766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.533468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.533468] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.533468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.533468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.533683] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.533775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.534326] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.885344] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 1151.885582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.896542] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.896772] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.896909] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.897230] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.897532] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.897717] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.897845] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.898112] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.898288] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.898549] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.898692] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.898815] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.898953] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.899092] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.899202] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.899333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.920240] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.920452] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.920610] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.920823] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.921203] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-2fbe8bbf-7b03-4848-835f-15c7cdf38616 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.921409] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.921543] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.921905] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.922068] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fbe8bbf-7b03-4848-835f-15c7cdf38616',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.036978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.037202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.037293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.037693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.037693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.037693] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.037955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.037955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.038019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.038062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.038148] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f already deleted. [ 1152.038245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.424232] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.424517] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.424625] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.424929] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.425082] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.425213] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 2fbe8bbf-7b03-4848-835f-15c7cdf38616 not found, creating... [ 1152.425479] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.425640] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.425757] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.425963] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.426122] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.426441] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.426603] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.426720] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.426920] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.427065] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.427208] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 is going to be created. [ 1152.447907] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.448170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.448531] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.448913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.449048] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.449288] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.905984] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e in Status: SUCCESS [ 1152.906347] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d7d6455-8f79-4497-9ae4-0a26ac23c21e deletion is rescheduled due to dependency. [ 1152.906389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d7d6455-8f79-4497-9ae4-0a26ac23c21e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.162398] env[66131]: INFO networking_nsxv3.common.synchronization [req-32263ef3-1f94-44d6-af30-cc43526cf377 req-96db727e-1c1e-43f3-82ca-c9354ea9c455 service nova] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1153.162578] env[66131]: INFO networking_nsxv3.common.synchronization [req-32263ef3-1f94-44d6-af30-cc43526cf377 req-96db727e-1c1e-43f3-82ca-c9354ea9c455 service nova] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1153.162714] env[66131]: INFO networking_nsxv3.common.synchronization [req-32263ef3-1f94-44d6-af30-cc43526cf377 req-96db727e-1c1e-43f3-82ca-c9354ea9c455 service nova] Enqueued Resource ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 with Priority: HIGHEST for action port [ 1153.163247] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1153.163376] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1153.163472] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 with Priority: HIGHEST for action port [ 1153.163737] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.163852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.163918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.164534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.164534] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.166231] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.166680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.166905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.167234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.167573] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.167730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.168871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.168871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.168871] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.168871] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.169745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fbe8bbf-7b03-4848-835f-15c7cdf38616 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.169745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.169745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.169745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.169745] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fbe8bbf-7b03-4848-835f-15c7cdf38616',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.351616] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1153.351616] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1153.351616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.671695] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.672955] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.673148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.673407] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fbe8bbf-7b03-4848-835f-15c7cdf38616 with status ACTIVE [ 1153.673615] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.673729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.673785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.673991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.674094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.674572] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.674572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.674572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.674572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.674826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.674826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.674900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.674929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.675128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.675128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.675225] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 is going to be updated. [ 1153.698177] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.698177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.698399] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.698493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.698678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.698843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.177853] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.680385] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.680522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.680614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.680846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.680941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.681060] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f is going to be created. [ 1154.707299] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.707578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.707641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.707875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.707993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.717889] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: UNINITIALIZED for 2s [ 1156.730053] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: SUCCESS [ 1156.730401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.730441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.730768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.731039] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.731173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.731244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.731405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.731488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.731579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.731721] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.234279] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.321804] env[66131]: INFO networking_nsxv3.common.synchronization [req-cfe4a11a-630a-4a8b-bee7-e7140899442c req-08c947f7-a1f2-4a7f-a8d2-d6c2e05e7d41 tempest-ServerRescueNegativeTestJSON-2124249713 tempest-ServerRescueNegativeTestJSON-2124249713-project-member] Enqueued Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 1157.322381] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 with Priority: HIGHEST for action security_group_members [ 1157.322704] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.322840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.322907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.323124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.323279] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.323388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.323449] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.323626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.323694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.323778] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d18d1e64-ca33-4d89-b4cf-d9d209fdd092',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.736726] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ddf38c-8199-4778-8bfa-d0398cc8006f: rpc.has_security_group_logging(os_id): False [ 1157.756994] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.757164] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.757356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.757689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.757754] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.758133] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.758250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.758352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.758557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.758638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.758734] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f is going to be created. [ 1157.824877] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.825055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.825114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.825338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.825543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.826777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.826910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.826985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.827253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.843500] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: IN_PROGRESS for 2s [ 1157.952537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.952852] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.952980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.953075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.953319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.953438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.953500] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 is going to be updated. [ 1158.013198] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.013429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.013429] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.014049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.014049] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.024918] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: IN_PROGRESS for 2s [ 1159.857428] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: SUCCESS [ 1159.857826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.035294] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 in Status: SUCCESS [ 1160.035545] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d18d1e64-ca33-4d89-b4cf-d9d209fdd092 deletion is rescheduled due to dependency. [ 1160.035642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d18d1e64-ca33-4d89-b4cf-d9d209fdd092" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.323936] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1162.324251] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1163.813243] env[66131]: INFO networking_nsxv3.common.synchronization [req-e689b814-0bf6-4506-99c3-0d3d9706df92 req-78efd6bd-7759-41f2-b452-f913e3c5b593 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1163.813243] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1163.813243] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.813243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.813243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.813243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.813243] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.813243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.813243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.813243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.813818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.813818] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.138415] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.138860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.138860] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.139067] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.139335] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.139491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.139605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.140530] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.140773] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.141037] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.141165] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.141365] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.141516] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.141650] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.141808] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.141989] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.173435] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.173616] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.173753] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.173933] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.174323] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.174502] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.174624] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.174954] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.175108] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e2eff6-39c2-44f5-aa8a-12b687cfc13f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.315928] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.677363] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.677603] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.677719] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.678016] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.678172] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.678348] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 77e2eff6-39c2-44f5-aa8a-12b687cfc13f not found, creating... [ 1164.678597] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.678754] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.678872] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.679097] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.679234] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.679519] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.679685] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.679819] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.680038] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.680191] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.680336] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 77e2eff6-39c2-44f5-aa8a-12b687cfc13f is going to be created. [ 1164.701476] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.701696] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.701804] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.702103] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.702339] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.702562] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.818337] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.321041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.321205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.321279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.321497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.321619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.321761] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1165.350609] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.350753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.350828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.351088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.351184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.359981] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1165.391051] env[66131]: INFO networking_nsxv3.common.synchronization [req-e689b814-0bf6-4506-99c3-0d3d9706df92 req-0a8c11da-718c-4b25-959a-165420027e30 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1165.391247] env[66131]: INFO networking_nsxv3.common.synchronization [req-e689b814-0bf6-4506-99c3-0d3d9706df92 req-0a8c11da-718c-4b25-959a-165420027e30 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1165.391444] env[66131]: INFO networking_nsxv3.common.synchronization [req-e689b814-0bf6-4506-99c3-0d3d9706df92 req-0a8c11da-718c-4b25-959a-165420027e30 service nova] Enqueued Resource ID: 77e2eff6-39c2-44f5-aa8a-12b687cfc13f with Priority: HIGHEST for action port [ 1165.391981] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1165.392141] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1165.392242] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e2eff6-39c2-44f5-aa8a-12b687cfc13f with Priority: HIGHEST for action port [ 1165.392514] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.392651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.392682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.392982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.393081] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.394287] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.394424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.394634] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.394745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.395731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.395731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.395731] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e2eff6-39c2-44f5-aa8a-12b687cfc13f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.898087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.898087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.898087] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77e2eff6-39c2-44f5-aa8a-12b687cfc13f with status ACTIVE [ 1165.898087] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.898087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.898087] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.898673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.898673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.898673] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.898673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.898673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.898839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.898839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.899076] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.899177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.899299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.899382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.899459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.899545] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77e2eff6-39c2-44f5-aa8a-12b687cfc13f is going to be updated. [ 1165.922485] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.922485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.922485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.922485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.922729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.922762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e2eff6-39c2-44f5-aa8a-12b687cfc13f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.481562] env[66131]: INFO networking_nsxv3.common.synchronization [req-b8807a99-9d23-4ac8-81e2-f8dcf6aa99ab req-6f59b94a-c6dc-46e3-9844-051126f16a29 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_members [ 1166.483043] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f with Priority: HIGHEST for action security_group_members [ 1166.483457] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.483638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.486369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.486369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.486369] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.486369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.486369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.486369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.486369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.486369] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5ce0271-b593-4da3-ae20-ecdb3d31bc3f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.988544] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.988972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.988972] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.989065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.008826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.009102] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.009225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.009291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.009484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.009567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.009657] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f is going to be updated. [ 1167.053415] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.053579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.053636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.053860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.053999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.066488] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f in Status: IN_PROGRESS for 2s [ 1167.371217] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1167.372067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.372401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.373043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.373043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.373301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.373301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.373371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.373403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.374111] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.875639] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.378439] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.880704] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.880857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.880927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.881173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.881593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.881593] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1168.911479] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.911634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.911634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.911820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.911965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.922345] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1169.076739] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f in Status: SUCCESS [ 1169.076977] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce0271-b593-4da3-ae20-ecdb3d31bc3f deletion is rescheduled due to dependency. [ 1169.077059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce0271-b593-4da3-ae20-ecdb3d31bc3f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.639771] env[66131]: INFO networking_nsxv3.common.synchronization [req-6f71979c-7568-4ff3-80fc-071e7c754787 req-f9115485-157c-4b28-ad66-dcab695210a4 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1170.640354] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1170.640670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.640794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.640861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.641065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.641219] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.641347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.641386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.641540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.641620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.641710] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.933168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1170.933389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.933582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.933849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.934153] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.934153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.934290] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.934409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.934485] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.934569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.934657] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.942302] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.942491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.942613] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.942854] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.943114] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.943608] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.943608] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.943608] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.943730] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.943971] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.944036] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.944181] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.944250] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.944350] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.944458] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.944585] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.966477] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.966742] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.966807] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.966989] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-485" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.967326] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-18d3d560-a071-4e77-af6d-23dc1fcee282 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.967737] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.967900] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.968319] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.968525] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d3d560-a071-4e77-af6d-23dc1fcee282',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.144270] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.144468] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.144565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.144970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.145092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.145403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.145464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.145523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.145773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.145837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.145941] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1171.173089] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.173089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.173089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.173358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.173358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.182550] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1171.436929] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.437112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.437184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.437613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.437613] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.437689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.437770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.437898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.437985] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.438086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.438237] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.438810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.438810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.438810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.438810] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.438810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.438810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.439092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.439092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.439092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.439216] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.470917] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.471232] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.471357] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.471561] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.472333] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.472333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 18d3d560-a071-4e77-af6d-23dc1fcee282 not found, creating... [ 1171.472333] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.472561] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.472759] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.473093] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.473367] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.473781] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.474037] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.474233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.474561] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.474766] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.474957] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 18d3d560-a071-4e77-af6d-23dc1fcee282 is going to be created. [ 1171.495413] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.495634] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.495762] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.496277] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.496277] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.496674] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.941545] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1171.959364] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.959557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.959606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.959890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.960031] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.960252] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.960372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.960430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.960601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.960682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.960880] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.961027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.961097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.961254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.961321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.961516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.961622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.961699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.961825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.961896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.962047] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1172.023055] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.023294] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.023294] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.023471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.023616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.043896] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1172.226344] env[66131]: INFO networking_nsxv3.common.synchronization [req-6f71979c-7568-4ff3-80fc-071e7c754787 req-bef318f1-4600-495d-a68c-b5405a608909 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1172.226572] env[66131]: INFO networking_nsxv3.common.synchronization [req-6f71979c-7568-4ff3-80fc-071e7c754787 req-bef318f1-4600-495d-a68c-b5405a608909 service nova] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1172.226722] env[66131]: INFO networking_nsxv3.common.synchronization [req-6f71979c-7568-4ff3-80fc-071e7c754787 req-bef318f1-4600-495d-a68c-b5405a608909 service nova] Enqueued Resource ID: 18d3d560-a071-4e77-af6d-23dc1fcee282 with Priority: HIGHEST for action port [ 1172.227272] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_rules [ 1172.227434] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1172.227565] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d3d560-a071-4e77-af6d-23dc1fcee282 with Priority: HIGHEST for action port [ 1172.227834] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.227954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.228043] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.228400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.228400] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.229641] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.229759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.229973] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d3d560-a071-4e77-af6d-23dc1fcee282 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.230100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.230176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.230353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.230429] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d3d560-a071-4e77-af6d-23dc1fcee282',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.334942] env[66131]: INFO networking_nsxv3.common.synchronization [None req-7253105a-4ac9-4fb5-ac17-bcb2b1171b81 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_rules [ 1172.335548] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_rules [ 1172.335837] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.335999] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.336081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.336432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.336519] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.442020] env[66131]: INFO networking_nsxv3.common.synchronization [None req-57293db3-e9ea-4f96-a33a-3438f6b9e553 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_rules [ 1172.442551] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_rules [ 1172.442879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.442990] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.735584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.735584] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18d3d560-a071-4e77-af6d-23dc1fcee282 with status ACTIVE [ 1172.735584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.735584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.735584] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.736014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.736014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.736014] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.736118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.736118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.736296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.736350] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.736546] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18d3d560-a071-4e77-af6d-23dc1fcee282 is going to be updated. [ 1172.759586] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.759735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.759735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.759920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.760068] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.760690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d3d560-a071-4e77-af6d-23dc1fcee282" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.859582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.859582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.859582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.859582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.859900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.859900] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 already deleted. [ 1172.859900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.859998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.863349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.863349] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.192499] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1173.192813] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1173.192869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.193069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.193289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.193479] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.193598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.193664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.193817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.193900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.193995] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.391294] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.391530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.391530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.391776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.391776] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.391896] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 already deleted. [ 1173.392109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.696622] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.065664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1174.065991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.199276] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.703209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.703209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.703209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.703209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.703696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.703696] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1174.732686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.732995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.732995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.733209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.733365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.744140] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1176.765053] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1176.765053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.765053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.765053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.765053] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.765053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.765053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.765827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.765827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.765827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.765827] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.268810] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.268948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.269061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.269381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.269652] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.269821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.269870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.270010] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.270101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.270189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.270342] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.270436] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.270504] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.270642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.270777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.270872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.270949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.271124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.271201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.271281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.271371] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.443832] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.444110] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1177.503562] env[66131]: INFO networking_nsxv3.common.synchronization [req-d2f877ad-5132-494b-bdc8-663074bb5172 req-c1cde82d-b163-49a0-b324-987481870e9e tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1177.504149] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1177.504477] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.504598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.504666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.504863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.505181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.505276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.505334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.505496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.505590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.505683] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.773911] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d95303b6-7e26-444d-bfa3-5518dbc80e21: rpc.has_security_group_logging(os_id): False [ 1177.793478] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.793658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.793775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.793966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.794083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.794340] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.794635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.794635] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.794736] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.794896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.795085] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.795197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.795278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.795431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.795529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.795790] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.795918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.796076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.796475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.796475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.796475] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1177.865859] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.865966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.866070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.866278] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.866425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.908498] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1178.009792] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.484763] env[66131]: INFO networking_nsxv3.common.synchronization [req-18c2324b-7f18-491e-8fef-639c9adeb645 req-8692a0ee-6868-448f-aca4-8ef7ee74eef2 tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1178.485315] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1178.485613] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.485733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.485800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.486117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.486332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.486450] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.486567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.486740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.486829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.486941] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.511846] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.966834] env[66131]: INFO networking_nsxv3.common.synchronization [req-d99eedba-c54c-4b93-ae3a-551b46257683 req-5c86abf7-3e8c-4b5e-9d63-99891fe523c1 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_members [ 1178.967586] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_members [ 1178.968017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.968193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.968295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.968641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.968879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.969028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.969126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.969344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.969490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.969610] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.988606] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.988753] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.988841] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.989070] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.989165] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.989358] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.989477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.989545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.989690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.989790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.989879] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1179.014998] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.015192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.015280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.015490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.015587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.015689] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1179.018062] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.018062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.018062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.018231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.018231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.031091] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1179.047614] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.047795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.047872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.048114] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.048326] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.058745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1179.315707] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-402 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.315946] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.316084] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.316352] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.316648] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.316814] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.316932] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.317161] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.317307] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.317529] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.317656] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.317769] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.317911] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.317986] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.318103] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.318230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.340373] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.341637] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.341637] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.341637] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.341637] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-6b38462a-5695-427a-b72e-c0c47dca43c3 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.341637] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.341637] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.341903] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.341903] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b38462a-5695-427a-b72e-c0c47dca43c3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.471945] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.472197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.472281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.472611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.472938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.473229] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.473390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.473483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.473676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.473777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.473903] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 already deleted. [ 1179.474024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.844193] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.844458] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.844593] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.844862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.845022] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.845179] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 6b38462a-5695-427a-b72e-c0c47dca43c3 not found, creating... [ 1179.845439] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.845591] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.845706] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.845914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.846060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.846331] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.846530] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.846629] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.846832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.846963] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.847121] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 6b38462a-5695-427a-b72e-c0c47dca43c3 is going to be created. [ 1179.867994] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.868196] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.868293] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.868550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.868784] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.868997] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.925691] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1179.925934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.564243] env[66131]: INFO networking_nsxv3.common.synchronization [req-d99eedba-c54c-4b93-ae3a-551b46257683 req-0e4adb18-b604-42b1-9ff7-f57d4202f279 service nova] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_rules [ 1180.564243] env[66131]: INFO networking_nsxv3.common.synchronization [req-d99eedba-c54c-4b93-ae3a-551b46257683 req-0e4adb18-b604-42b1-9ff7-f57d4202f279 service nova] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_members [ 1180.564853] env[66131]: INFO networking_nsxv3.common.synchronization [req-d99eedba-c54c-4b93-ae3a-551b46257683 req-0e4adb18-b604-42b1-9ff7-f57d4202f279 service nova] Enqueued Resource ID: 6b38462a-5695-427a-b72e-c0c47dca43c3 with Priority: HIGHEST for action port [ 1180.564853] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_rules [ 1180.564853] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_members [ 1180.564853] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b38462a-5695-427a-b72e-c0c47dca43c3 with Priority: HIGHEST for action port [ 1180.565640] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.565840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.565873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.566073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.566156] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.568814] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.568814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.568814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.568814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.568814] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.569171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.569171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.569171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.569304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.569350] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.571209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b38462a-5695-427a-b72e-c0c47dca43c3 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.571209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.571209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.571209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.571209] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b38462a-5695-427a-b72e-c0c47dca43c3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.041393] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1181.041578] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 deletion is rescheduled due to dependency. [ 1181.041692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.066354] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1181.066651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.071307] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.073098] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b38462a-5695-427a-b72e-c0c47dca43c3 with status ACTIVE [ 1181.073345] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.073474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.073543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.073802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.073912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.074120] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.074236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.074293] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.074870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.074870] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.074870] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.075047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.075047] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.075242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.075242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.075384] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b38462a-5695-427a-b72e-c0c47dca43c3 is going to be updated. [ 1181.076429] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.076581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.096428] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.096645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.096751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.097151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.097876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.097876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b38462a-5695-427a-b72e-c0c47dca43c3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.573779] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.157619] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.157619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.158535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.158535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.158535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.158535] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 is going to be created. [ 1182.187058] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.187337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.187337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187490] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.187678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.197983] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a95ef8-6420-4157-a95a-01a299e13157 in Status: UNINITIALIZED for 2s [ 1184.209980] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a95ef8-6420-4157-a95a-01a299e13157 in Status: SUCCESS [ 1184.210374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.210414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.210612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.210847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.210971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.211050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.211216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.211300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.211387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.211478] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.713560] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.216160] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4a95ef8-6420-4157-a95a-01a299e13157: rpc.has_security_group_logging(os_id): False [ 1185.233600] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.233831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.233905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.234231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.234374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.234762] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.234915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.235034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.235274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.235406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.235543] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 is going to be created. [ 1185.292080] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.292319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.292319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.292508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.292685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.302981] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4a95ef8-6420-4157-a95a-01a299e13157 in Status: IN_PROGRESS for 2s [ 1185.566140] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1185.566247] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1187.268367] env[66131]: INFO networking_nsxv3.common.synchronization [req-4ccde775-525d-43cf-8768-d9cf5ee340fc req-dff0c9ea-f185-4ccb-807b-4779a8c80434 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_members [ 1187.268367] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGHEST for action security_group_members [ 1187.268755] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.268755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.268755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.268989] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.269153] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.269259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.269324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.269483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.269573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.269669] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.315417] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4a95ef8-6420-4157-a95a-01a299e13157 in Status: SUCCESS [ 1187.315417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.772163] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.772371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.772371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.772603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.772701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.772892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.772987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.773060] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.773205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.773281] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.773371] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 is going to be updated. [ 1187.801698] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.801858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.801902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.802140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.802277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.811627] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: IN_PROGRESS for 2s [ 1188.543979] env[66131]: INFO networking_nsxv3.common.synchronization [req-5416d658-e2b1-4b4d-9865-fe87916453d1 req-cad86f74-ad66-44e4-bf2d-2cc42e982732 tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1188.546278] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1188.546763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.546922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.546993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.549175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.549175] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.549175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.549175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.550204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.550204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.550204] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.910764] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.910971] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.911084] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.911350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.911603] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.911743] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.911864] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.912091] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.912239] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.912441] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.912546] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.913347] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.913347] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.913347] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.913347] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.913347] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.935736] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.935928] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.936168] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.937152] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.937152] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-ccd7acba-5663-45d6-8f14-a169687a0db1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.937152] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.937152] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.937374] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.937514] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccd7acba-5663-45d6-8f14-a169687a0db1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.055477] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.055684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.055684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.055930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.056040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.056240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.056334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.056389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.056536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.056967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.057112] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1189.089435] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.089435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.089701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.089803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.089947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.101149] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1189.441853] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.441853] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.442195] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.442337] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.442506] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.442664] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port ccd7acba-5663-45d6-8f14-a169687a0db1 not found, creating... [ 1189.442929] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.443108] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.443226] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.443451] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.443588] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.443865] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.444037] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.444194] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.444358] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.444491] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.444644] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: ccd7acba-5663-45d6-8f14-a169687a0db1 is going to be created. [ 1189.464996] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.465279] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.465279] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.465683] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.465944] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.466195] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.822637] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 in Status: SUCCESS [ 1189.823073] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 deletion is rescheduled due to dependency. [ 1189.823073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.177131] env[66131]: INFO networking_nsxv3.common.synchronization [req-5416d658-e2b1-4b4d-9865-fe87916453d1 req-2cdea5b5-e411-4775-901c-dd45bdcd1606 service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 1190.177131] env[66131]: INFO networking_nsxv3.common.synchronization [req-5416d658-e2b1-4b4d-9865-fe87916453d1 req-2cdea5b5-e411-4775-901c-dd45bdcd1606 service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1190.177131] env[66131]: INFO networking_nsxv3.common.synchronization [req-5416d658-e2b1-4b4d-9865-fe87916453d1 req-2cdea5b5-e411-4775-901c-dd45bdcd1606 service nova] Enqueued Resource ID: ccd7acba-5663-45d6-8f14-a169687a0db1 with Priority: HIGHEST for action port [ 1190.177437] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 1190.177437] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1190.177503] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd7acba-5663-45d6-8f14-a169687a0db1 with Priority: HIGHEST for action port [ 1190.177810] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.177954] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.178088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.178277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.178362] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.179247] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.179366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.180009] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccd7acba-5663-45d6-8f14-a169687a0db1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.180009] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.180009] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.180009] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.180009] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccd7acba-5663-45d6-8f14-a169687a0db1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.682881] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.683093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.683207] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccd7acba-5663-45d6-8f14-a169687a0db1 with status ACTIVE [ 1190.683373] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.683500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.683558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.683768] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.683852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.684032] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.684123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.684180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.684324] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.684396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.684580] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.684685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.684750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.684922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.684996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.685108] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccd7acba-5663-45d6-8f14-a169687a0db1 is going to be updated. [ 1190.705623] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.705786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.705828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.706037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.706175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.706325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.782675] env[66131]: INFO networking_nsxv3.common.synchronization [req-a0057bfa-71fc-4d28-9c8c-faf1b62c6b84 req-58065939-02bc-4cbf-ade0-1c36de04288a tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1190.783439] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1190.783826] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.783977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.784055] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.784361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.784431] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.784505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.784557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.784703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.784789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.784883] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.113014] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.113404] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.113404] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.113635] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.113901] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.114158] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.114383] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.114479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.114692] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.114986] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.115210] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.115413] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.115668] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.115790] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.115980] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.116115] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.117866] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1191.118078] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 deletion is rescheduled due to dependency. [ 1191.118151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.118669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.118856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.119071] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.119180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.119214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.119366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.119462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.119559] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.142692] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.142937] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.143056] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.143252] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-280" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.143586] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.143763] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.143886] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.144271] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.144409] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.287574] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.621865] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.646621] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.646951] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.647103] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.647382] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.647532] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.647684] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f not found, creating... [ 1191.647980] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.648155] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.648270] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.648483] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.648620] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.648912] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.649289] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.649421] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.649629] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.649765] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.650162] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f is going to be created. [ 1191.691392] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.691663] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.691757] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.692055] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.692311] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.692538] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.790773] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.124759] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.291828] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.292549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.292549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.292676] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.292765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.293189] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1192.327846] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.328033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.328077] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.328329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.328415] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.339133] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1192.385890] env[66131]: INFO networking_nsxv3.common.synchronization [req-a0057bfa-71fc-4d28-9c8c-faf1b62c6b84 req-ea67d608-9d6a-4ba3-b3aa-30ad64871660 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1192.386143] env[66131]: INFO networking_nsxv3.common.synchronization [req-a0057bfa-71fc-4d28-9c8c-faf1b62c6b84 req-ea67d608-9d6a-4ba3-b3aa-30ad64871660 service nova] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1192.386367] env[66131]: INFO networking_nsxv3.common.synchronization [req-a0057bfa-71fc-4d28-9c8c-faf1b62c6b84 req-ea67d608-9d6a-4ba3-b3aa-30ad64871660 service nova] Enqueued Resource ID: 6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f with Priority: HIGHEST for action port [ 1192.387459] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_rules [ 1192.387688] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1192.387894] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f with Priority: HIGHEST for action port [ 1192.388313] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.388593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.388722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.389019] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.389219] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.390348] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.390515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.390803] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.391329] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.391482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.391748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.391891] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.627513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.627739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.627833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.628148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.628265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.628394] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1192.661797] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.661797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.662237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.662237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.662625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.675708] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1192.895186] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.895417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.895709] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f with status ACTIVE [ 1192.895995] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.896237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.896348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.896614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.896752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.896938] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.897059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.897129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.897291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.897373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.897562] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.897665] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.897779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.897901] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.897987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.898091] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f is going to be updated. [ 1192.918939] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.919146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.919146] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.919371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.920135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.920135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ccae21e-fe27-4e78-a9f0-3c5b8fa5ac9f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.356050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1194.356483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.356756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.357168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.357275] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.357402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.357470] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.357712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.357824] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.358013] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.686929] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1194.687545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.687545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.687699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.687939] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.688089] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.688159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.688581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.688581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.688581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.688718] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.860425] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.191459] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.366829] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.694035] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30740e8f-2016-47cb-9949-af7efd303581: rpc.has_security_group_logging(os_id): False [ 1195.714273] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.714464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.714464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.714690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.714842] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.715059] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.715163] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.715229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.715386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.715467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.715556] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1195.781583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.781859] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.781933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.782189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.782412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.799626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1195.871383] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.871591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.871591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.871830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.871928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.872113] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1195.921578] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.921783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.921783] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.922000] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.922196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.932986] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1197.388881] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1197.389297] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1197.830947] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1197.831221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.955262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1197.955580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.955845] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.956125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.956316] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.956433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.956524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.956839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.956978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.957101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.957210] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.294666] env[66131]: INFO networking_nsxv3.common.synchronization [req-c2c0cc57-e5c5-4fdd-acc4-4663589ce47e req-1b4ce5e2-0a35-438a-a828-8fba946fb038 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1198.296404] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1198.296404] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.296404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.296404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.296404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.296646] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.296646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.296807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.296959] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.297028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.297385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.459461] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.459952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.459952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.460045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.460222] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.460372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.460452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.460577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.460712] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.460798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.460987] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.461133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.461133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.461279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.461420] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.461500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.461613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.461726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.461827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.461883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.462039] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.683653] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.683861] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.683989] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.684281] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.684538] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.684699] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.684843] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.685082] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.685235] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.685445] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.685555] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.685661] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.685768] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.685993] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.685993] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.686117] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.749695] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.749822] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.064 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.749991] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.750189] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.750703] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-6650c302-a811-46a0-bcf8-e146b3abe1df taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.751144] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.751393] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.751888] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.752170] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6650c302-a811-46a0-bcf8-e146b3abe1df',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.800222] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.800222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.800222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.800222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.800222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.800548] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.800548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.800548] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.800660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.800774] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.800918] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be updated. [ 1198.867399] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.867552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.867627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.867887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.868083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.890807] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: IN_PROGRESS for 2s [ 1198.964111] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66976a1f-1587-4537-a4a6-12265096339d: rpc.has_security_group_logging(os_id): False [ 1198.987858] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.988130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.988130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.988340] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.988435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.988640] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.988741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.988802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.988978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.989095] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.989245] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.989342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.989410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.989536] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.989601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.989797] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.989888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.989949] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.990542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.990542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.990542] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1199.125375] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.125517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.125587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.125808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.125955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.167878] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1199.255452] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.255688] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.255808] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.256138] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.256282] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.256435] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 6650c302-a811-46a0-bcf8-e146b3abe1df not found, creating... [ 1199.256760] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.256925] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.257059] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.257297] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.257437] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.257735] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.257888] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.258014] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.258233] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.258369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.258504] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 6650c302-a811-46a0-bcf8-e146b3abe1df is going to be created. [ 1199.308555] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.308770] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.308930] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.309255] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.309602] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.309725] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.985260] env[66131]: INFO networking_nsxv3.common.synchronization [req-c2c0cc57-e5c5-4fdd-acc4-4663589ce47e req-a01b1883-b652-4222-89e5-68af05504fa6 service nova] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_rules [ 1199.985260] env[66131]: INFO networking_nsxv3.common.synchronization [req-c2c0cc57-e5c5-4fdd-acc4-4663589ce47e req-a01b1883-b652-4222-89e5-68af05504fa6 service nova] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1199.985260] env[66131]: INFO networking_nsxv3.common.synchronization [req-c2c0cc57-e5c5-4fdd-acc4-4663589ce47e req-a01b1883-b652-4222-89e5-68af05504fa6 service nova] Enqueued Resource ID: 6650c302-a811-46a0-bcf8-e146b3abe1df with Priority: HIGHEST for action port [ 1199.990028] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_rules [ 1199.990028] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1199.990028] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6650c302-a811-46a0-bcf8-e146b3abe1df with Priority: HIGHEST for action port [ 1199.990028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.990028] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.990028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.990028] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6650c302-a811-46a0-bcf8-e146b3abe1df taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.990028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.990028] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6650c302-a811-46a0-bcf8-e146b3abe1df',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.492459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.492684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.492852] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6650c302-a811-46a0-bcf8-e146b3abe1df with status ACTIVE [ 1200.493093] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.493211] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.493270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.493552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.493666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.493935] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.494050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.494121] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.494308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.494477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.494620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.494775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.495123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.495123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.495123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.495248] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6650c302-a811-46a0-bcf8-e146b3abe1df is going to be updated. [ 1200.525280] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.525467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.525551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.525784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.525939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.526104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.903411] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1200.903838] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff deletion is rescheduled due to dependency. [ 1200.903838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.904024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.904194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.904401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.904559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.904559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.905022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.905243] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.905484] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.183800] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1201.184192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.408158] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.910455] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.414156] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.414503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.414503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.414639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.414709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.414841] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be updated. [ 1202.451462] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.451656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.451656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.451839] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.451984] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.461043] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: IN_PROGRESS for 2s [ 1204.474217] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1204.474496] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.474622] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.474895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.475118] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.475254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.475352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.475461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.475554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.475638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.475733] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.977961] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.978199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.978266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.978455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.978630] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.978727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.978790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.978935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.979036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.979127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.979276] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.979367] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.979426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.979562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.979695] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.979786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.979843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.979975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.980064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.980144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.980244] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.988326] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.988472] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1205.482819] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b136f51b-9f69-44ec-b06b-d90265f6efff: rpc.has_security_group_logging(os_id): False [ 1205.503617] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.503799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.503867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.504061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.504157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.504422] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.504566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.504634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.504830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.504915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.505222] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.505357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.505357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.505486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.505540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.505733] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.505825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.505887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.506406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.506406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.506406] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be updated. [ 1205.577594] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.577815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.577815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.578071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.578222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.591802] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: IN_PROGRESS for 2s [ 1206.235199] env[66131]: INFO networking_nsxv3.common.synchronization [req-d20f0b83-8504-4ecd-ae05-9a3286743757 req-43f6cc95-9988-4a72-a911-8bde76b4d831 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1206.235657] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1206.235998] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.236135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.236199] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.236401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.236557] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.236694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.236740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.237276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.237276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.237276] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.740679] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.243391] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.609489] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1207.609759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.746772] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.747183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.747183] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.747354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.747437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.747540] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1207.805646] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.805823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.805866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.806096] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.806274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.816730] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1209.507570] env[66131]: INFO networking_nsxv3.common.synchronization [req-1ecd4708-e34e-4165-8da7-5dff8e0936a9 req-02fef322-c07b-465b-850c-701771732a09 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1209.508811] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b136f51b-9f69-44ec-b06b-d90265f6efff with Priority: HIGHEST for action security_group_members [ 1209.508811] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b136f51b-9f69-44ec-b06b-d90265f6efff taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.508811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.508811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.509133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.509198] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.509311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.509395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.509930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.509930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.509930] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b136f51b-9f69-44ec-b06b-d90265f6efff',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.561029] env[66131]: INFO networking_nsxv3.common.synchronization [req-1ecd4708-e34e-4165-8da7-5dff8e0936a9 req-02fef322-c07b-465b-850c-701771732a09 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: 6650c302-a811-46a0-bcf8-e146b3abe1df with Priority: HIGHEST for action port [ 1209.561029] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6650c302-a811-46a0-bcf8-e146b3abe1df with Priority: HIGHEST for action port [ 1209.561604] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-6650c302-a811-46a0-bcf8-e146b3abe1df taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.561898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.562142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.562616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.563752] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6650c302-a811-46a0-bcf8-e146b3abe1df',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.828512] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1209.828763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.012785] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.013026] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.013076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.013297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.013397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.013595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.013700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.013801] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.014014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.014139] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.014235] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff is going to be updated. [ 1210.050047] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.050210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.050282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.050528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.050645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.061233] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: IN_PROGRESS for 2s [ 1210.064677] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6650c302-a811-46a0-bcf8-e146b3abe1df with status ACTIVE [ 1210.064955] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.065128] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.065200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.065438] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.065530] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.065712] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.065809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.065874] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.066029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.066105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.066288] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.066380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.066435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.066574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.066646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.066730] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6650c302-a811-46a0-bcf8-e146b3abe1df is going to be updated. [ 1210.093884] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.094135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.094135] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.094331] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.094470] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.094632] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6650c302-a811-46a0-bcf8-e146b3abe1df" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.071677] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b136f51b-9f69-44ec-b06b-d90265f6efff in Status: SUCCESS [ 1212.072120] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b136f51b-9f69-44ec-b06b-d90265f6efff deletion is rescheduled due to dependency. [ 1212.072120] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b136f51b-9f69-44ec-b06b-d90265f6efff" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.313792] env[66131]: INFO networking_nsxv3.common.synchronization [req-9a8b2dc5-9e36-4f26-b5e1-0fc1237083e3 req-9f9117a0-a1e7-45e5-8b72-c840eb38c683 tempest-DeleteServersTestJSON-1319828271 tempest-DeleteServersTestJSON-1319828271-project-member] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1213.314465] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGHEST for action security_group_members [ 1213.314860] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.315585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.315585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.315585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.315585] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.315585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.315585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.315865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.315865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.315925] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.820129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.820129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.820129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.820129] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be updated. [ 1213.853644] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.853644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.853644] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.853812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.853857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.864258] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: IN_PROGRESS for 2s [ 1214.083036] env[66131]: INFO networking_nsxv3.common.synchronization [req-29b481f0-01d8-4375-bcf5-a759826c89ca req-f520ae73-c3bc-4d88-add2-8d41217af7d3 tempest-ServersTestJSON-1490790918 tempest-ServersTestJSON-1490790918-project-member] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1214.083585] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGHEST for action security_group_members [ 1214.083964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.084158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.084248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.084543] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.084686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.084809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.084907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.085123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.085245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.085365] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.587307] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.587722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.587722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.587722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.587827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.588281] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.588462] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.588554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.588761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.588878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.588999] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be updated. [ 1214.621514] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.621514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.621514] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.621980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.621980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.633617] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: IN_PROGRESS for 2s [ 1215.874516] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 in Status: SUCCESS [ 1215.874908] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 deletion is rescheduled due to dependency. [ 1215.874908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.644614] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66976a1f-1587-4537-a4a6-12265096339d in Status: SUCCESS [ 1216.644995] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66976a1f-1587-4537-a4a6-12265096339d deletion is rescheduled due to dependency. [ 1216.645159] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.084588] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1219.085111] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1223.033729] env[66131]: INFO networking_nsxv3.common.synchronization [None req-70e0808e-00ad-4c5c-8c72-cdacd7cbd52e None None] Enqueued Resource ID: 3b9e03e0-6291-4bff-8003-7adec66afcd6 with Priority: HIGHEST for action port [ 1223.034556] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9e03e0-6291-4bff-8003-7adec66afcd6 with Priority: HIGHEST for action port [ 1223.034701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9e03e0-6291-4bff-8003-7adec66afcd6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.034820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9e03e0-6291-4bff-8003-7adec66afcd6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.034880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9e03e0-6291-4bff-8003-7adec66afcd6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.035270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9e03e0-6291-4bff-8003-7adec66afcd6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.035359] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9e03e0-6291-4bff-8003-7adec66afcd6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.537762] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b9e03e0-6291-4bff-8003-7adec66afcd6 [ 1223.538043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.538209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.538380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.539025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.539025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.539025] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b9e03e0-6291-4bff-8003-7adec66afcd6 already deleted. [ 1223.539025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9e03e0-6291-4bff-8003-7adec66afcd6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.185411] env[66131]: INFO networking_nsxv3.common.synchronization [None req-7084131a-d098-4539-a0c8-e3cea104d517 tempest-ServerActionsV293TestJSON-1005479135 tempest-ServerActionsV293TestJSON-1005479135-project-member] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_rules [ 1224.185704] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_rules [ 1224.186017] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.186148] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.186215] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.186456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.186540] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.269900] env[66131]: INFO networking_nsxv3.common.synchronization [None req-b1e4f5b3-26ee-4a18-90b1-09d0d2b5abe7 tempest-ServerActionsV293TestJSON-1005479135 tempest-ServerActionsV293TestJSON-1005479135-project-member] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_rules [ 1224.270433] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_rules [ 1224.270737] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.270834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.708171] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.708349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.708421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.708634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.708727] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.708829] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 already deleted. [ 1224.708909] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.709073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.709223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.709295] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.985840] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5ad87899-0f6e-4705-aa88-1e66b99b4be9 None None] Enqueued Resource ID: 595a6baf-c7a1-40e9-8003-07bd10424447 with Priority: HIGHEST for action port [ 1224.986702] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 595a6baf-c7a1-40e9-8003-07bd10424447 with Priority: HIGHEST for action port [ 1224.987256] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-595a6baf-c7a1-40e9-8003-07bd10424447 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.987410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-595a6baf-c7a1-40e9-8003-07bd10424447" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.987508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-595a6baf-c7a1-40e9-8003-07bd10424447" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.987779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-595a6baf-c7a1-40e9-8003-07bd10424447" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.987867] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('595a6baf-c7a1-40e9-8003-07bd10424447',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.231220] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.231526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.231526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.231643] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.231728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.231821] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 already deleted. [ 1225.231898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.490574] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 595a6baf-c7a1-40e9-8003-07bd10424447 [ 1225.490666] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.490830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.490960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.491355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.491484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.491608] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:595a6baf-c7a1-40e9-8003-07bd10424447 already deleted. [ 1225.491715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-595a6baf-c7a1-40e9-8003-07bd10424447" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.987933] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1229.988380] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1231.214467] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.214838] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.214838] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.215145] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.215492] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.215701] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.215875] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.216171] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.216466] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.216649] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.216819] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1231.217008] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1231.217212] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1231.217436] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.217876] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1231.218050] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1231.253797] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1231.254122] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1231.254368] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1231.254638] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-887" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.255080] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-2fbe8bbf-7b03-4848-835f-15c7cdf38616 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.255347] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.255574] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.255940] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.256231] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fbe8bbf-7b03-4848-835f-15c7cdf38616',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.759172] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.759490] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.759605] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.759900] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.760070] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.760383] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.760548] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.760666] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.760885] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.761034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.761323] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.761479] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.761595] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.761797] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.761957] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.762118] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 is going to be updated. [ 1231.786243] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.786540] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.786604] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.786848] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.787088] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.787369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.455927] env[66131]: INFO networking_nsxv3.common.synchronization [req-0cbee3e5-91b7-4d07-9099-4016e658e9fb req-001546e0-817d-4b04-a478-b3c32ab7728c service nova] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1232.456210] env[66131]: INFO networking_nsxv3.common.synchronization [req-0cbee3e5-91b7-4d07-9099-4016e658e9fb req-001546e0-817d-4b04-a478-b3c32ab7728c service nova] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1232.456311] env[66131]: INFO networking_nsxv3.common.synchronization [req-0cbee3e5-91b7-4d07-9099-4016e658e9fb req-001546e0-817d-4b04-a478-b3c32ab7728c service nova] Enqueued Resource ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 with Priority: HIGHEST for action port [ 1232.456949] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_rules [ 1232.457155] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1232.457287] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 with Priority: HIGHEST for action port [ 1232.458639] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.458639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.458639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.458639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.458639] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.459382] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.459579] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.459677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.459879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.460073] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.460210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.460296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.460464] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.460566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.460680] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.461806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fbe8bbf-7b03-4848-835f-15c7cdf38616 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.461806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.461806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.461806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.462586] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fbe8bbf-7b03-4848-835f-15c7cdf38616',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.964018] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.964171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.964370] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.965632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fbe8bbf-7b03-4848-835f-15c7cdf38616 with status ACTIVE [ 1232.965830] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.965948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.966028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.966394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.966394] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.966505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.966594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.967374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.967374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.967374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.967374] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.967374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.967374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.967374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.967758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.967758] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fbe8bbf-7b03-4848-835f-15c7cdf38616 is going to be updated. [ 1232.990489] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.990814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.990962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.991356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.991497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.991724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fbe8bbf-7b03-4848-835f-15c7cdf38616" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.469533] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.973125] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.973383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.973383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.973647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.973740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.973877] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f is going to be updated. [ 1234.018517] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.018517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.018517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.018826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.018826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.029339] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: IN_PROGRESS for 2s [ 1235.666029] env[66131]: INFO networking_nsxv3.common.synchronization [req-03fec912-971e-4b06-967d-ba8e224a382a req-20569232-adc5-4107-a4e6-29aac81982e2 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1235.667021] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1235.667021] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.667392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.667392] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.667566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.667695] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.667695] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.667837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.668040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.668040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.668204] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.042781] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: SUCCESS [ 1236.043061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.043249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.043746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.043746] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.044048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.044048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.044151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.044151] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.044246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.044334] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.092325] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.092556] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.092655] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.092966] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.094824] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.095019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.095309] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.095624] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.095796] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.096040] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.096231] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.096372] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.096509] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.096632] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.096781] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.096883] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.121725] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.121905] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1236.122058] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.122324] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-682" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.122578] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.122757] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.122876] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.123271] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.123412] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81e4d4e-5c2a-40e0-8fa9-18734c579e92',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.171316] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.547081] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.626215] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.626536] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.626630] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.626859] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.627023] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.627260] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port b81e4d4e-5c2a-40e0-8fa9-18734c579e92 not found, creating... [ 1236.627610] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.627867] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.628088] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.628472] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.628679] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.629098] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.629282] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.629378] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.629628] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.629756] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.629896] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: b81e4d4e-5c2a-40e0-8fa9-18734c579e92 is going to be created. [ 1236.656489] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.656841] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.657060] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.657499] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.657857] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.658227] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.674355] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.049739] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ddf38c-8199-4778-8bfa-d0398cc8006f: rpc.has_security_group_logging(os_id): False [ 1237.071879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.072044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.072123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.072342] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.072443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.072694] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.072796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.072864] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.073062] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.073108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.073211] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f is going to be updated. [ 1237.145553] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.145785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.145785] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.146454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.146454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.161297] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: IN_PROGRESS for 2s [ 1237.176584] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.177244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.177244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.177501] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.177617] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.177772] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1237.214591] env[66131]: INFO networking_nsxv3.common.synchronization [req-7f5a8c72-3997-4662-a4f9-236dcbe47ea6 req-8b9b0d73-656e-43a2-9a73-9d2158962163 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_members [ 1237.214726] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a with Priority: HIGHEST for action security_group_members [ 1237.215347] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b77736a7-a5de-40ee-af04-cb5c681cfc4a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.215508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.215508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.215744] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.215970] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.216085] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.216174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.216384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.216526] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.216657] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b77736a7-a5de-40ee-af04-cb5c681cfc4a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.230555] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.230703] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.231104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.231104] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.231593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.258209] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1237.404287] env[66131]: INFO networking_nsxv3.common.synchronization [req-03fec912-971e-4b06-967d-ba8e224a382a req-10f261e3-838f-42ab-9cc3-ba1a1bffe6b2 service nova] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 1237.404287] env[66131]: INFO networking_nsxv3.common.synchronization [req-03fec912-971e-4b06-967d-ba8e224a382a req-10f261e3-838f-42ab-9cc3-ba1a1bffe6b2 service nova] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1237.404287] env[66131]: INFO networking_nsxv3.common.synchronization [req-03fec912-971e-4b06-967d-ba8e224a382a req-10f261e3-838f-42ab-9cc3-ba1a1bffe6b2 service nova] Enqueued Resource ID: b81e4d4e-5c2a-40e0-8fa9-18734c579e92 with Priority: HIGHEST for action port [ 1237.409803] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_rules [ 1237.409911] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1237.410040] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81e4d4e-5c2a-40e0-8fa9-18734c579e92 with Priority: HIGHEST for action port [ 1237.410382] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.410538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.410625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.410786] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.410874] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.412244] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.412369] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.412921] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.413192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.413279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.413478] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.413577] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81e4d4e-5c2a-40e0-8fa9-18734c579e92',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.718934] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.719357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.719357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.719437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.719557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.719758] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.719855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.719942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.720185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.720185] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.720316] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a is going to be updated. [ 1237.759581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.759822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.759822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.760021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.760173] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.772505] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a in Status: IN_PROGRESS for 2s [ 1237.916549] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.916799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.916931] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b81e4d4e-5c2a-40e0-8fa9-18734c579e92 with status ACTIVE [ 1237.917284] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.917431] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.917494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.917714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.917866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.918183] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.918317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.918401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.918682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.918820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.919145] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.919279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.919358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.919540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.919646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.919746] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b81e4d4e-5c2a-40e0-8fa9-18734c579e92 is going to be updated. [ 1237.974917] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.975171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.975325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.975660] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.975878] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.976009] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b81e4d4e-5c2a-40e0-8fa9-18734c579e92" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.177621] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: SUCCESS [ 1239.178023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.268566] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1239.268797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.268942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.269188] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.269391] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.269508] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.269581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.269745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.269826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.269922] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.772768] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.784289] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a in Status: SUCCESS [ 1239.784476] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b77736a7-a5de-40ee-af04-cb5c681cfc4a deletion is rescheduled due to dependency. [ 1239.784576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b77736a7-a5de-40ee-af04-cb5c681cfc4a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.276843] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.780205] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.780205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.780205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.780205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.780205] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.780205] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1240.819522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.819729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.819780] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.819983] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.820339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.830692] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1242.410586] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.410991] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1242.843864] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1242.844204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.844500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.844867] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.844964] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.845158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.845273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.845454] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.845594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.845875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.845981] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.282541] env[66131]: INFO networking_nsxv3.common.synchronization [req-4551982f-dd98-41fc-a6bf-98ef9327bb92 req-fde3a0a2-067e-46d6-936a-7b83136cb22a tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_members [ 1243.283314] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGHEST for action security_group_members [ 1243.283414] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.283474] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.283545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.283798] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.283980] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.284689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.284689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.284789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.284789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.285574] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.349320] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.787191] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.787542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.787542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.787770] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.787818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.788102] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.788209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.788304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.788532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.788701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.788820] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 is going to be updated. [ 1243.821777] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.821777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.822034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.822172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.822338] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.831774] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a95ef8-6420-4157-a95a-01a299e13157 in Status: IN_PROGRESS for 2s [ 1243.852322] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a68adb37-f05f-44c4-a13b-7eb7bc0ab766: rpc.has_security_group_logging(os_id): False [ 1243.871951] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.872141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.872210] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.872447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.872540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.872793] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.872893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.872963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.873125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.873200] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.873290] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1243.948177] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.948177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.948177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.948177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.948595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.965230] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1245.768167] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1245.768167] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:3 started [ 1245.846135] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a95ef8-6420-4157-a95a-01a299e13157 in Status: SUCCESS [ 1245.846345] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 deletion is rescheduled due to dependency. [ 1245.846420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.981536] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1245.981812] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.283972] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.284383] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1250.215916] env[66131]: INFO networking_nsxv3.common.synchronization [None req-cd53cbe6-1a0a-43f8-b036-35a260b936ec tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_rules [ 1250.216807] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_rules [ 1250.216807] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.219372] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.219550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.220236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.220236] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.315553] env[66131]: INFO networking_nsxv3.common.synchronization [None req-84d77fc6-d312-4f6f-8813-cdec3ef60b98 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_rules [ 1250.316168] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_rules [ 1250.316502] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.316610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.747024] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.747024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.747024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.747337] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.747401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.747522] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3524095-a1d8-4e89-823e-93c3b176609b already deleted. [ 1250.747658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.748420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.748420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.748420] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.270189] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.270189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.270766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.270766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.270766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.270882] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3524095-a1d8-4e89-823e-93c3b176609b already deleted. [ 1251.270918] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.204856] env[66131]: INFO networking_nsxv3.common.synchronization [req-0be14f60-aa68-4b94-bb7e-53f92f98e036 req-de6dffa6-c89d-4859-91cd-54c45a455f5f tempest-ServerActionsV293TestJSON-1005479135 tempest-ServerActionsV293TestJSON-1005479135-project-member] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_members [ 1252.205482] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_members [ 1252.205806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.205926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.205993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.206419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.206585] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.206761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.206827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.207061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.207181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.207237] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.556852] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.556852] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-780" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.556852] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-780" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.557285] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-780" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.557390] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.557617] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.557816] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.558144] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.558430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.558720] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.558863] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.559009] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.559174] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.559342] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1252.559486] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.559683] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.582131] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.582365] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1252.582569] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.582826] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-780" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.583309] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-1f54d78c-935d-4fb3-a39e-4dbca99f9054 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.583594] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.583736] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.584172] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.584350] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f54d78c-935d-4fb3-a39e-4dbca99f9054',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.710378] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.710616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.710616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.710899] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.710993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.711229] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.711339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.711404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.711595] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.711687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.711757] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 already deleted. [ 1252.711840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.087714] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.087954] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.088097] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.088382] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.088533] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.088689] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 1f54d78c-935d-4fb3-a39e-4dbca99f9054 not found, creating... [ 1253.088979] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.089125] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.089244] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.089459] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.089591] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.089899] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.090111] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.090229] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.090987] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.091154] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.091502] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 1f54d78c-935d-4fb3-a39e-4dbca99f9054 is going to be created. [ 1253.114550] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.114550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.114550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.114550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.114550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.114550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.872853] env[66131]: INFO networking_nsxv3.common.synchronization [req-0be14f60-aa68-4b94-bb7e-53f92f98e036 req-e1b02c5c-9aef-4115-a4bd-35b51b53bd21 service nova] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_rules [ 1253.873129] env[66131]: INFO networking_nsxv3.common.synchronization [req-0be14f60-aa68-4b94-bb7e-53f92f98e036 req-e1b02c5c-9aef-4115-a4bd-35b51b53bd21 service nova] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_members [ 1253.873281] env[66131]: INFO networking_nsxv3.common.synchronization [req-0be14f60-aa68-4b94-bb7e-53f92f98e036 req-e1b02c5c-9aef-4115-a4bd-35b51b53bd21 service nova] Enqueued Resource ID: 1f54d78c-935d-4fb3-a39e-4dbca99f9054 with Priority: HIGHEST for action port [ 1253.873975] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_rules [ 1253.874278] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_members [ 1253.874419] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f54d78c-935d-4fb3-a39e-4dbca99f9054 with Priority: HIGHEST for action port [ 1253.874760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.874920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.875021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.875236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.875321] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.876755] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.876876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.876944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.877175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.877514] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.877625] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.877693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.877849] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.877951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.878059] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.879589] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f54d78c-935d-4fb3-a39e-4dbca99f9054 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.879589] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.879746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.879947] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.880287] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f54d78c-935d-4fb3-a39e-4dbca99f9054',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.377389] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.377389] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.380050] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.382210] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f54d78c-935d-4fb3-a39e-4dbca99f9054 with status ACTIVE [ 1254.382401] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.382520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.382586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.382836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.383020] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.383151] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.383253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.383311] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.383477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.383557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.383736] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.383831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.383890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.384046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.384124] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.384211] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f54d78c-935d-4fb3-a39e-4dbca99f9054 is going to be updated. [ 1254.407016] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.407236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.407236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.407509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.407707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.407883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f54d78c-935d-4fb3-a39e-4dbca99f9054" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.882420] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.002629] env[66131]: INFO networking_nsxv3.common.synchronization [req-ee64637f-594a-4ab0-beec-9fc00a78e386 req-b04e3d50-7630-4046-8cb7-217332325762 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_members [ 1255.003294] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGHEST for action security_group_members [ 1255.003544] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.003664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.003819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.003955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.005037] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.005037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.005184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.007646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.007646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.007646] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.385722] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.388166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.388166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.388166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.388166] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.388166] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 is going to be created. [ 1255.424027] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.424027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.424027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.424027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.424027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.439026] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: UNINITIALIZED for 2s [ 1255.511106] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.511106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.511106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.511106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.511106] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.511489] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.511489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.511489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.511489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.511687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.511687] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd is going to be updated. [ 1255.547482] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.547699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.547816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.548056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.548207] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.559340] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd in Status: IN_PROGRESS for 2s [ 1257.448547] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: SUCCESS [ 1257.448915] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.448980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.449226] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.449430] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.449545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.449614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.449773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.449850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.449945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.450054] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.570106] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd in Status: SUCCESS [ 1257.570300] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd deletion is rescheduled due to dependency. [ 1257.570419] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.952490] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.455451] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4: rpc.has_security_group_logging(os_id): False [ 1258.479268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.479441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.479500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.479763] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.479889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.480185] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.480288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.480357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.480524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.480600] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.480726] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 is going to be created. [ 1258.569097] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.569354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.569354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.569511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.569684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.592590] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: IN_PROGRESS for 2s [ 1259.253798] env[66131]: INFO networking_nsxv3.common.synchronization [req-8e24ba2f-e60b-41ab-997b-55234243fe23 req-a6cfe231-bc4b-4c66-b089-039b52059498 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_members [ 1259.254520] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_members [ 1259.254945] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.256684] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.257349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.257675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.257858] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.257971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.258048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.258213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.258302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.258404] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.566893] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-402 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.567390] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.567390] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.567646] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.567867] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.568140] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.568319] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.568951] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.569171] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.569420] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.569681] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.569681] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.569855] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.570013] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.570160] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.570333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.589788] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.590042] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1259.590145] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.590320] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-402" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.590632] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-ffa3edb9-5901-4844-a722-bc1c8825d051 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.590822] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.590940] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.591290] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.591597] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa3edb9-5901-4844-a722-bc1c8825d051',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.761088] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.761088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.761088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.761088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.761088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.761386] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.761386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.761386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.761505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.761569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.761652] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3524095-a1d8-4e89-823e-93c3b176609b already deleted. [ 1259.761733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.096028] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.096292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.096444] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.096755] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.096907] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.097081] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port ffa3edb9-5901-4844-a722-bc1c8825d051 not found, creating... [ 1260.097357] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.097716] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.097863] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.098114] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.098262] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.098610] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.098784] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.098904] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.099134] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.099269] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.099407] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: ffa3edb9-5901-4844-a722-bc1c8825d051 is going to be created. [ 1260.119048] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.119249] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.119369] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.119628] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.119852] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.120081] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.605382] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: SUCCESS [ 1260.605382] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.876393] env[66131]: INFO networking_nsxv3.common.synchronization [req-8e24ba2f-e60b-41ab-997b-55234243fe23 req-2a834bd1-b50f-4b5b-a9eb-6a67dc911939 service nova] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_rules [ 1260.876595] env[66131]: INFO networking_nsxv3.common.synchronization [req-8e24ba2f-e60b-41ab-997b-55234243fe23 req-2a834bd1-b50f-4b5b-a9eb-6a67dc911939 service nova] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_members [ 1260.876768] env[66131]: INFO networking_nsxv3.common.synchronization [req-8e24ba2f-e60b-41ab-997b-55234243fe23 req-2a834bd1-b50f-4b5b-a9eb-6a67dc911939 service nova] Enqueued Resource ID: ffa3edb9-5901-4844-a722-bc1c8825d051 with Priority: HIGHEST for action port [ 1260.877323] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_rules [ 1260.877530] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_members [ 1260.878239] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa3edb9-5901-4844-a722-bc1c8825d051 with Priority: HIGHEST for action port [ 1260.878581] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.878707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.878784] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.879092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.879160] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.880348] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.880499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.880549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.880758] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.881115] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.881115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.881115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.881233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.881262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.881353] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.882800] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffa3edb9-5901-4844-a722-bc1c8825d051 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.883795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.883795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.883795] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.883795] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa3edb9-5901-4844-a722-bc1c8825d051',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.216193] env[66131]: INFO networking_nsxv3.common.synchronization [None req-096dafb9-6617-447e-8aad-5ff9279fab64 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_rules [ 1261.216584] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_rules [ 1261.216959] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.217231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.217231] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.217505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.217600] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.325019] env[66131]: INFO networking_nsxv3.common.synchronization [None req-602552ee-7ee8-41dc-bfe3-01c021c5bb5a tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_rules [ 1261.325742] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_rules [ 1261.326173] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.326315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.385701] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.386813] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.387037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.387109] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffa3edb9-5901-4844-a722-bc1c8825d051 with status ACTIVE [ 1261.387587] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.387587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.387587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.387831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.387831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.387967] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.388078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.388141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.388296] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.388370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.388570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.388657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.388716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.388863] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.388933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.389132] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffa3edb9-5901-4844-a722-bc1c8825d051 is going to be updated. [ 1261.416403] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.416572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.416618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.416820] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.416957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.417137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffa3edb9-5901-4844-a722-bc1c8825d051" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.740040] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.740509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.740509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.740509] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.740610] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.740653] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 already deleted. [ 1261.740741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.740895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.741061] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.741134] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.890909] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.261382] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.262091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.262204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.262397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.262497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.262609] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 already deleted. [ 1262.262692] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.394078] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.394078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.394078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.394078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.394078] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.394078] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3524095-a1d8-4e89-823e-93c3b176609b is going to be created. [ 1262.417240] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.417469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.417521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.417773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.417951] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.426688] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: UNINITIALIZED for 2s [ 1264.436889] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: SUCCESS [ 1264.437244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.437410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.437686] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.437887] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.438014] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.438080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.438275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.438409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.438528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.438629] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.940869] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.443862] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3524095-a1d8-4e89-823e-93c3b176609b: rpc.has_security_group_logging(os_id): False [ 1265.462883] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.463081] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.463176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.463421] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.463515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.463763] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.463922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.463922] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.464088] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.464213] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.464286] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3524095-a1d8-4e89-823e-93c3b176609b is going to be created. [ 1265.523866] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.524037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.524105] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.524318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.524494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.535624] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: IN_PROGRESS for 2s [ 1266.327298] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.327518] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1267.011203] env[66131]: INFO networking_nsxv3.common.synchronization [req-c7b7b0fa-04a1-4059-9b16-2f6593a6e1c4 req-948cb65a-3423-4dd5-8682-cf05eaccd043 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_members [ 1267.011756] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_members [ 1267.012129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.012284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.012359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.012623] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.012809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.012926] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.013076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.013268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.013559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.013559] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.300623] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.300835] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.300950] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.301473] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.301841] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.302026] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.302147] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.302380] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.302525] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.302739] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.302848] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1267.302951] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1267.303071] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1267.303203] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.303312] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1267.303440] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1267.339403] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1267.339664] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1267.339869] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1267.340136] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-339" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.340584] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-536aa424-b390-4a9e-b5b4-4f9569e20dde taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.340908] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.341104] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.341546] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.341745] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('536aa424-b390-4a9e-b5b4-4f9569e20dde',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.518233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.518233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.518233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.518233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.518233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.518233] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.518233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.518759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.518759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.518759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.518759] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 already deleted. [ 1267.518759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.549692] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: SUCCESS [ 1267.549944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.844054] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.844304] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.844430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.844748] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.844943] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.845052] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 536aa424-b390-4a9e-b5b4-4f9569e20dde not found, creating... [ 1267.845312] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.845496] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.845614] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.845834] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.845995] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.846284] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.846440] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.846555] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.846755] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.846887] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.847038] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 536aa424-b390-4a9e-b5b4-4f9569e20dde is going to be created. [ 1267.876132] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.876360] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.876492] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.876812] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.877063] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.877289] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.553293] env[66131]: INFO networking_nsxv3.common.synchronization [req-c7b7b0fa-04a1-4059-9b16-2f6593a6e1c4 req-2de49143-9442-44a9-bb54-e37e3d5e0c82 service nova] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_rules [ 1268.553586] env[66131]: INFO networking_nsxv3.common.synchronization [req-c7b7b0fa-04a1-4059-9b16-2f6593a6e1c4 req-2de49143-9442-44a9-bb54-e37e3d5e0c82 service nova] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_members [ 1268.553809] env[66131]: INFO networking_nsxv3.common.synchronization [req-c7b7b0fa-04a1-4059-9b16-2f6593a6e1c4 req-2de49143-9442-44a9-bb54-e37e3d5e0c82 service nova] Enqueued Resource ID: 536aa424-b390-4a9e-b5b4-4f9569e20dde with Priority: HIGHEST for action port [ 1268.554641] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_rules [ 1268.554895] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_members [ 1268.555101] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 536aa424-b390-4a9e-b5b4-4f9569e20dde with Priority: HIGHEST for action port [ 1268.555486] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.556453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.556453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.556803] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.557046] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.558572] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.559675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.559762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.560239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.560239] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.560239] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.560355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.560455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.560690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.560690] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.562641] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-536aa424-b390-4a9e-b5b4-4f9569e20dde taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.562641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.562641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.563021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.563107] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('536aa424-b390-4a9e-b5b4-4f9569e20dde',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.065124] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.065300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.065544] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.067105] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 536aa424-b390-4a9e-b5b4-4f9569e20dde with status ACTIVE [ 1269.067350] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.067511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.067611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.067914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.068067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.068332] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.068480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.068577] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.068816] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.068941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.069231] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.069441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.069476] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.069688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.069809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.069934] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 536aa424-b390-4a9e-b5b4-4f9569e20dde is going to be updated. [ 1269.095041] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.095270] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.095377] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.095681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.095879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.096117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-536aa424-b390-4a9e-b5b4-4f9569e20dde" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.572947] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.744311] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.744548] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.744712] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.745050] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.745369] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.745571] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.745710] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.745981] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.746181] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.746427] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.746578] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.746730] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.746855] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.747016] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.747250] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.747329] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.768937] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.769172] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1269.769260] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.769380] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-256" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.770102] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-ccd7acba-5663-45d6-8f14-a169687a0db1 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.770102] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.770284] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.770411] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.770515] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccd7acba-5663-45d6-8f14-a169687a0db1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.077407] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.077611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.078840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.078840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.078840] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.078840] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 is going to be created. [ 1270.104136] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.104302] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.104388] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.104580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.104745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.114599] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: UNINITIALIZED for 2s [ 1270.273473] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.273775] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.274070] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.274463] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.274709] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.275114] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.275371] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.275550] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.275913] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.276103] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.276566] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.276801] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.277011] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.277575] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.277751] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.278063] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: ccd7acba-5663-45d6-8f14-a169687a0db1 is going to be updated. [ 1270.311414] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.311711] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.311837] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.312170] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.312371] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.312596] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.989688] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0b48f39-670a-41c7-82a4-fd198666b1fb req-1058de43-6057-430b-b414-1f736479d625 service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 1270.989937] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0b48f39-670a-41c7-82a4-fd198666b1fb req-1058de43-6057-430b-b414-1f736479d625 service nova] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1270.990045] env[66131]: INFO networking_nsxv3.common.synchronization [req-c0b48f39-670a-41c7-82a4-fd198666b1fb req-1058de43-6057-430b-b414-1f736479d625 service nova] Enqueued Resource ID: ccd7acba-5663-45d6-8f14-a169687a0db1 with Priority: HIGHEST for action port [ 1270.991328] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_rules [ 1270.991431] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1270.991524] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd7acba-5663-45d6-8f14-a169687a0db1 with Priority: HIGHEST for action port [ 1270.993833] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.993833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.993833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.993833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.993833] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.995513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.995513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.995513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.995513] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.995933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.997374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.997374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.997374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.997374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.997374] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.997861] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccd7acba-5663-45d6-8f14-a169687a0db1 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.997861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.997861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.997982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.998111] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccd7acba-5663-45d6-8f14-a169687a0db1',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.496228] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.496437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.499777] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.502387] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccd7acba-5663-45d6-8f14-a169687a0db1 with status ACTIVE [ 1271.502595] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.502735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.502815] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.503074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.503169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.503370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.503482] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.503550] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.503737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.503821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.504015] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.504119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.504192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.504376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.504481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.504637] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccd7acba-5663-45d6-8f14-a169687a0db1 is going to be updated. [ 1271.526370] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.526574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.526574] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.526925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.526925] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.527112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccd7acba-5663-45d6-8f14-a169687a0db1" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.001923] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.124467] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: SUCCESS [ 1272.124771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.124869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.125080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.125281] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.125396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.125463] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.125606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.125688] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.125772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.125861] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.504458] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.505395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.505395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.505395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.505395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.505395] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1272.544571] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.544811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.544811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.545521] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.545699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.556333] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1272.628019] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.130386] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9: rpc.has_security_group_logging(os_id): False [ 1273.152126] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.152300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.152300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.152571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.152693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.152963] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.153180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.153277] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.153467] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.153572] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.153686] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 is going to be created. [ 1273.216644] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.216916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.216916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.217086] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.217265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.229111] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: IN_PROGRESS for 2s [ 1274.568503] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1274.568826] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.568961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.569237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.569440] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.569559] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.569626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.569777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.569860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.569993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.570105] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.073120] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.243286] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: SUCCESS [ 1275.243631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.263962] env[66131]: INFO networking_nsxv3.common.synchronization [req-8714c93d-e2bb-485f-bfef-ff262fd2d365 req-ddf4cfce-6712-4dc9-a4ef-ab1708c8d54f tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1275.264568] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1275.265038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.265038] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.265202] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.265395] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.265621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.265746] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.265838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.266083] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.266223] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.266385] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.575763] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30740e8f-2016-47cb-9949-af7efd303581: rpc.has_security_group_logging(os_id): False [ 1275.598758] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.598955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.599045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.599280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.599379] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.599615] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.599715] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.599778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.599941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.599987] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.600095] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1275.676543] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.676771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.676771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.677093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.677280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.692111] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1275.768782] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.769065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.769065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.769585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.769729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.770253] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.770253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.770253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.770253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.770535] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.770535] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1275.816892] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.817123] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.817181] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.817381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.817527] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.827424] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1277.707618] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1277.707978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.838920] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1277.838920] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e deletion is rescheduled due to dependency. [ 1277.838920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.265718] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.266047] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1282.725622] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.726111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.726111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.726111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.726232] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.228121] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.695246] env[66131]: INFO networking_nsxv3.common.synchronization [req-55d031a1-5b54-4775-ae17-d03f080d2e1e req-e28fd7c3-c515-4809-9fa0-b41da68dad61 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1283.696375] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1283.696791] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.697024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.697024] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.697306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.697489] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.697619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.697734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.698174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.698174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.698297] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.730689] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.018056] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.018220] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.018292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.018572] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.018828] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.018986] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.019119] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.019330] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.019475] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.019728] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1284.019848] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1284.019956] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1284.020081] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1284.020194] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1284.020301] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1284.020437] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1284.040200] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1284.040375] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1284.040466] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1284.040647] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.040970] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-325e97ea-84c2-4218-a885-f623bef7a303 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.041161] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.041281] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.041614] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.041788] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325e97ea-84c2-4218-a885-f623bef7a303',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.201615] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.201615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.201615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.201897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.201897] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.201976] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.202092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.202157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.202309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.202386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.202471] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1284.233868] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1284.234114] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1284.236766] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.236906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.236975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.237176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.237318] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.247282] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1284.544633] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.544955] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.545320] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.545772] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.545960] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.546168] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 325e97ea-84c2-4218-a885-f623bef7a303 not found, creating... [ 1284.546482] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.546713] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.546831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.547121] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.547292] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.547623] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.547862] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.547986] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.548223] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.548377] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.548537] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 325e97ea-84c2-4218-a885-f623bef7a303 is going to be created. [ 1284.576069] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.576069] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.576069] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.576407] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.576446] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.576660] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.161978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.162416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.162416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.162416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.175499] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1285.176364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.177222] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1285.222607] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.222846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.222846] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.223072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.239234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.240085] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1285.240207] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1285.240258] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1285.291649] env[66131]: INFO networking_nsxv3.common.synchronization [req-55d031a1-5b54-4775-ae17-d03f080d2e1e req-406765ce-794a-486b-9dcf-e7776323719f service nova] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 1285.291891] env[66131]: INFO networking_nsxv3.common.synchronization [req-55d031a1-5b54-4775-ae17-d03f080d2e1e req-406765ce-794a-486b-9dcf-e7776323719f service nova] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1285.291982] env[66131]: INFO networking_nsxv3.common.synchronization [req-55d031a1-5b54-4775-ae17-d03f080d2e1e req-406765ce-794a-486b-9dcf-e7776323719f service nova] Enqueued Resource ID: 325e97ea-84c2-4218-a885-f623bef7a303 with Priority: HIGHEST for action port [ 1285.292518] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 1285.292660] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1285.292840] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 325e97ea-84c2-4218-a885-f623bef7a303 with Priority: HIGHEST for action port [ 1285.293147] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.293267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.293332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.293533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.293616] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.294728] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.294905] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.295098] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-325e97ea-84c2-4218-a885-f623bef7a303 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.295220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.295287] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.295477] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.295554] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325e97ea-84c2-4218-a885-f623bef7a303',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.299052] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.299136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.299176] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.299357] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.301299] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.301299] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1285.408634] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.408856] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.408932] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.409155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.409469] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.409749] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1285.497946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.498168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.498168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.498410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.498739] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.499128] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1285.499247] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b4a95ef8-6420-4157-a95a-01a299e13157', 'd3524095-a1d8-4e89-823e-93c3b176609b', '3951e5e1-7963-4597-8681-5924c72de16e', 'dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9', '30740e8f-2016-47cb-9949-af7efd303581', 'd95303b6-7e26-444d-bfa3-5518dbc80e21', 'c23c566c-2b2f-4799-89b7-6a402d4e19dd', 'e4314113-ddb6-40ad-8c52-48dfb885822e', '68c9165c-8a0c-4c77-ac74-d69dfa2767dd', '46e5ff25-a7e6-4827-af48-1a633ae5e029', 'a68adb37-f05f-44c4-a13b-7eb7bc0ab766', '78ae03e4-1f7c-4fdb-b2b5-0a039dcede95', '66976a1f-1587-4537-a4a6-12265096339d', '28ee1eeb-3432-45a9-a6f2-8c319e5f2db4', 'ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207', '69f85143-50cb-4ea4-b72b-837126da5251', '6518e255-8a48-4fe6-8c80-b478b31e143a', '0f3bfadc-ee4e-4dd7-a668-86025968cc1f', '87932d1b-2e10-4f4e-b38c-90b3b495ce14', '395c7bb1-0365-458d-a01e-64a431cc84a0', 'eef72789-9405-4544-841f-1905c2771a0d', '2d46ac8a-ba3b-4036-8bf0-647896954581', '8c5da787-634a-44a5-9a16-ff46306549cf', 'ef5c2151-bad2-47ce-a462-d37d0b06e5f6', '6270fe51-9cd9-43e6-84a8-7fa928433147', '1d7d6455-8f79-4497-9ae4-0a26ac23c21e', 'd18d1e64-ca33-4d89-b4cf-d9d209fdd092', '88c2f217-48ed-4b9b-b2f8-5e8fec9e586d', '72ddf38c-8199-4778-8bfa-d0398cc8006f', 'b77736a7-a5de-40ee-af04-cb5c681cfc4a', 'a7fc9052-f286-4d53-8d9d-b976649d992e', '1c204a4b-a669-4fe4-b5e6-edacdb0d1270', '091418bc-6d4e-4be2-bfdc-783bb4e9e92b', '019f05d6-48e0-4ee7-bcb4-af4a1a2925af', '3affe7d0-eaa2-49d5-be04-f70f6d573297', 'f2fa4c76-baf8-4b86-a9b8-d6ad0b988f9a', 'efb89a8f-6be5-416d-bcac-1126e3f58519', '4320e0f3-4bbc-42b2-999c-7e766e099226', '3724e928-c7a7-4c1d-a230-ec565cc9eb94', 'b136f51b-9f69-44ec-b06b-d90265f6efff', '54bcb296-38dd-4765-9095-b0ead7c5de56', '635d180a-1a27-4897-8f2c-a14eca9102c1', 'c5ce0271-b593-4da3-ae20-ecdb3d31bc3f'} {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1285.499341] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1285.521650] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.521854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.521896] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.522142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.522236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.522351] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1285.522467] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1285.522525] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1285.611943] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.612221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.612221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.612430] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.613666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.614013] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1285.614181] env[66131]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66131) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1285.614262] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1285.614341] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1285.614479] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1285.614586] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGH for action security_group_rules [ 1285.614721] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGH for action security_group_rules [ 1285.614859] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGH for action security_group_rules [ 1285.615013] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGH for action security_group_rules [ 1285.615133] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGH for action security_group_rules [ 1285.615215] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGH for action security_group_rules [ 1285.615310] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGH for action security_group_rules [ 1285.615390] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGH for action security_group_rules [ 1285.615492] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGH for action security_group_rules [ 1285.615563] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGH for action security_group_rules [ 1285.615628] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGH for action security_group_rules [ 1285.615718] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGH for action security_group_rules [ 1285.615781] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGH for action security_group_rules [ 1285.615881] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGH for action security_group_rules [ 1285.616028] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGH for action security_group_rules [ 1285.616140] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGH for action security_group_rules [ 1285.616261] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGH for action security_group_rules [ 1285.616345] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGH for action security_group_rules [ 1285.616414] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGH for action security_group_rules [ 1285.616477] env[66131]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGH for action security_group_rules [ 1285.616590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.800125] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.800256] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.801254] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 325e97ea-84c2-4218-a885-f623bef7a303 with status ACTIVE [ 1285.801254] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.801254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.801254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.801254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.801254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.801254] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.801583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.801583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.801583] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.801671] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.802911] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.802911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.802911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.802911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.802911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.802911] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 325e97ea-84c2-4218-a885-f623bef7a303 is going to be updated. [ 1285.823686] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.823850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.823904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.824131] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.824262] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.824414] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-325e97ea-84c2-4218-a885-f623bef7a303" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [req-00ce00d1-510a-4faf-963b-34c3fabf72eb req-d72b8697-4a9b-446f-842b-fe9982c9f6df tempest-AttachVolumeShelveTestJSON-237574327 tempest-AttachVolumeShelveTestJSON-237574327-project-member] Enqueued Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f with Priority: HIGHEST for action security_group_members [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a95ef8-6420-4157-a95a-01a299e13157 with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951e5e1-7963-4597-8681-5924c72de16e with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518e255-8a48-4fe6-8c80-b478b31e143a with Priority: HIGH for action security_group_rules [ 1285.935760] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f85143-50cb-4ea4-b72b-837126da5251 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66976a1f-1587-4537-a4a6-12265096339d with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGH for action security_group_rules [ 1285.936818] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGH for action security_group_rules [ 1285.937227] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ddf38c-8199-4778-8bfa-d0398cc8006f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.937227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.937227] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.937347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.937484] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.937582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.937641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.937848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.937931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.940538] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ddf38c-8199-4778-8bfa-d0398cc8006f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.940538] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4a95ef8-6420-4157-a95a-01a299e13157 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.940538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.940538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.940538] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.940538] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4a95ef8-6420-4157-a95a-01a299e13157',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.942567] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3951e5e1-7963-4597-8681-5924c72de16e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.942672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.942672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.942807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.942891] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3951e5e1-7963-4597-8681-5924c72de16e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.943610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.943720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.943811] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.943933] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.944014] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23c566c-2b2f-4799-89b7-6a402d4e19dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.944903] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.945056] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.945374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.945573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.945657] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.946562] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395c7bb1-0365-458d-a01e-64a431cc84a0 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.946772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.946772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.946917] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.946964] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395c7bb1-0365-458d-a01e-64a431cc84a0',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.947970] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.948232] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.948327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.948452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.948525] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87932d1b-2e10-4f4e-b38c-90b3b495ce14',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.949196] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.949300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.949354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.949517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.949589] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3bfadc-ee4e-4dd7-a668-86025968cc1f',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.950291] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6518e255-8a48-4fe6-8c80-b478b31e143a taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.950376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.950410] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.950554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.950707] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6518e255-8a48-4fe6-8c80-b478b31e143a',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.951293] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.951400] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.951480] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.951626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.951718] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.952522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f85143-50cb-4ea4-b72b-837126da5251 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.952618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.952680] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.952830] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.952909] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f85143-50cb-4ea4-b72b-837126da5251',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.953574] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66976a1f-1587-4537-a4a6-12265096339d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.953681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.953748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.953895] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.953967] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66976a1f-1587-4537-a4a6-12265096339d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.954628] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.954732] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.954797] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.954940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.955019] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ae03e4-1f7c-4fdb-b2b5-0a039dcede95',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.955661] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.955767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.955833] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.955982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.956066] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.956862] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e5ff25-a7e6-4827-af48-1a633ae5e029 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.957034] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.957076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.957204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.957275] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e5ff25-a7e6-4827-af48-1a633ae5e029',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.957932] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.958050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.958115] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.958259] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.958331] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68c9165c-8a0c-4c77-ac74-d69dfa2767dd',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.959072] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d95303b6-7e26-444d-bfa3-5518dbc80e21 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.959175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.959241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.959381] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.959451] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d95303b6-7e26-444d-bfa3-5518dbc80e21',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.960198] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.960288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.960470] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.960565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.960627] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.960843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.960843] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.961481] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.961587] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.961651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.961791] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.961869] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.962948] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.963084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.963154] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.963303] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.963846] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.256214] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1286.256556] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e deletion is rescheduled due to dependency. [ 1286.256556] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.256620] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.256825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.256986] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.257116] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.257174] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.257327] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.257405] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.257498] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.468585] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.468585] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.468858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.470044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.470044] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.470044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.470044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.470044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.470044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.470044] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.470044] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.474341] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.474443] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.474532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.475113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.475113] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.475113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.475113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.475113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.475365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.475365] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.475365] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.476164] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.476362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.476432] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.476582] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.479620] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.479787] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.479880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.480059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.480241] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.480358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.480498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.480664] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.480769] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.480879] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.480970] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.483300] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.483300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.483300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.483445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.483591] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.483690] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.483755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.483898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.483979] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.484074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.484172] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.492530] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.498064] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.498198] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.498267] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.498630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.498809] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.498961] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.499048] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.499209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.499295] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.499378] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.499462] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.504626] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3524095-a1d8-4e89-823e-93c3b176609b: rpc.has_security_group_logging(os_id): False [ 1286.531812] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.532065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.534259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.534371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.538596] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.538782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.539582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.539678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.548238] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.548376] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.549079] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.549175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.551505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.551505] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.552221] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.552315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.553043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.553171] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.553858] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.553952] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.554541] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1286.554933] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.555037] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.555619] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1286.556317] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.556317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.556957] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1286.557354] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.557451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.558096] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1286.558578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.558790] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.558882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.558948] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.559155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.559235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.559323] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f is going to be updated. [ 1286.560761] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.560851] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.560919] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.561097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.562558] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.562675] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.586668] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1286.587197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.587320] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87932d1b-2e10-4f4e-b38c-90b3b495ce14 is going to be deleted. [ 1286.588383] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.588588] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.590552] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.590552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.590552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.590552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.590552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.598936] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: IN_PROGRESS for 2s [ 1286.610111] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.610239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e5ff25-a7e6-4827-af48-1a633ae5e029 is going to be deleted. [ 1286.611275] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.611492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.632298] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.632426] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207 is going to be deleted. [ 1286.633523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.633681] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.656339] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.656961] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d95303b6-7e26-444d-bfa3-5518dbc80e21 is going to be deleted. [ 1286.657576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.657881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.674479] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.674479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.678455] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.678455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.693518] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.693661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.694613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.694613] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23c566c-2b2f-4799-89b7-6a402d4e19dd is going to be deleted. [ 1286.695564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.695778] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.744772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.744952] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68c9165c-8a0c-4c77-ac74-d69dfa2767dd is going to be deleted. [ 1286.745858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.746109] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.747513] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.747641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.759713] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.819580] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.819711] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4a95ef8-6420-4157-a95a-01a299e13157 is going to be deleted. [ 1286.820743] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.820986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.842303] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.842493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.878542] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.878871] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.879010] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.879054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.879266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.879354] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.880077] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3524095-a1d8-4e89-823e-93c3b176609b is going to be updated. [ 1286.880640] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.880829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.905313] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.905492] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.911177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.911369] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3951e5e1-7963-4597-8681-5924c72de16e is going to be deleted. [ 1286.912396] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.912650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.963612] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.963763] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3bfadc-ee4e-4dd7-a668-86025968cc1f is going to be deleted. [ 1286.964725] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.964941] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.987928] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.993738] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.994646] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.003978] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.004193] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.010208] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.013015] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.013158] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6518e255-8a48-4fe6-8c80-b478b31e143a is going to be deleted. [ 1287.014359] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.014552] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.064711] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.064943] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.067657] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.067902] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.072894] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.073090] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66976a1f-1587-4537-a4a6-12265096339d is going to be deleted. [ 1287.074050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.074289] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.106451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.106640] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f85143-50cb-4ea4-b72b-837126da5251 is going to be deleted. [ 1287.107537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.107777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.119139] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.119351] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.138505] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.138728] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.165059] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.165349] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ae03e4-1f7c-4fdb-b2b5-0a039dcede95 is going to be deleted. [ 1287.166491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.166828] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.167023] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.167201] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87932d1b-2e10-4f4e-b38c-90b3b495ce14" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.167406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.167619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.167808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.168018] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e5ff25-a7e6-4827-af48-1a633ae5e029" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.168646] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.168821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.168927] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.169069] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed5fbaa2-c2ca-495e-8aa4-ad8d0c364207" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.169280] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.169434] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.169511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.169628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d95303b6-7e26-444d-bfa3-5518dbc80e21" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.169751] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.169890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.169965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.170140] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23c566c-2b2f-4799-89b7-6a402d4e19dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.170297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.170465] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.192921] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.193253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.262710] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.263132] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395c7bb1-0365-458d-a01e-64a431cc84a0 is going to be deleted. [ 1287.263890] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.264814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.264993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.265112] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.265245] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68c9165c-8a0c-4c77-ac74-d69dfa2767dd" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.265412] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.265576] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.265657] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.265806] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4a95ef8-6420-4157-a95a-01a299e13157" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.266390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.266578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.266734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.267789] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.267958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.268546] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.268691] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3951e5e1-7963-4597-8681-5924c72de16e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.269229] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.269409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.269494] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.269618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3bfadc-ee4e-4dd7-a668-86025968cc1f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.270147] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.270332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.270416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.270537] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6518e255-8a48-4fe6-8c80-b478b31e143a" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.270667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.270809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.270888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.270995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66976a1f-1587-4537-a4a6-12265096339d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.297119] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.297353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.297353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.297603] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.297733] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.297928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f85143-50cb-4ea4-b72b-837126da5251" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.339827] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: IN_PROGRESS for 2s [ 1287.411815] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.412042] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.412092] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.412297] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.412390] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.412511] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395c7bb1-0365-458d-a01e-64a431cc84a0" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.452734] env[66131]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1287.453411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.453621] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.453752] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.454127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.454263] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.454413] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ae03e4-1f7c-4fdb-b2b5-0a039dcede95" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.490027] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a68adb37-f05f-44c4-a13b-7eb7bc0ab766: rpc.has_security_group_logging(os_id): False [ 1287.496895] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4: rpc.has_security_group_logging(os_id): False [ 1287.498136] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30740e8f-2016-47cb-9949-af7efd303581: rpc.has_security_group_logging(os_id): False [ 1287.516969] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9: rpc.has_security_group_logging(os_id): False [ 1287.524740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.524888] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.524967] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.525221] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.526961] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.527099] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.530804] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.530982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.552510] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.552759] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.563829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.564224] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.564328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.564328] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.564529] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.564614] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.564710] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 is going to be updated. [ 1287.565788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.565958] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.606673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.607008] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.607126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.607196] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.607398] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.607484] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.607582] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1287.608988] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.609190] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.628711] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.629074] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.629189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.629258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.629459] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.629545] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.629632] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 is going to be updated. [ 1287.630651] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.630810] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.651760] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.651963] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.652724] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.652986] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.653091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.653157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.653363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.653435] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.653506] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1287.654562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.654731] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.654868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.676842] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: IN_PROGRESS for 2s [ 1287.686762] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.686914] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.686970] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.687212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.687360] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.721032] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.721249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.721249] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.721466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.721626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.735126] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1287.740877] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.741067] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.741137] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.741292] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.741437] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.747330] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: IN_PROGRESS for 2s [ 1287.757115] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1287.769772] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.769945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.769945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.770214] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.770315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.770420] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1287.844759] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.845009] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.845091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.845265] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.846472] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.864935] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1288.166552] env[66131]: INFO networking_nsxv3.common.synchronization [req-90d30eed-3a0c-46de-9870-d42148e490c9 req-7a96f4b3-df29-4857-a45e-ac659c1359b9 tempest-ServerActionsTestOtherB-1006959993 tempest-ServerActionsTestOtherB-1006959993-project-member] Enqueued Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1288.167129] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30740e8f-2016-47cb-9949-af7efd303581 with Priority: HIGHEST for action security_group_members [ 1288.167438] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-30740e8f-2016-47cb-9949-af7efd303581 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.167829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.167829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.167977] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.169182] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.169325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.169455] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.169566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.169667] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.169815] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30740e8f-2016-47cb-9949-af7efd303581',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.610027] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f in Status: SUCCESS [ 1288.610397] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ddf38c-8199-4778-8bfa-d0398cc8006f deletion is rescheduled due to dependency. [ 1288.610397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ddf38c-8199-4778-8bfa-d0398cc8006f" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.672120] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.672319] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.672358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.672672] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.672818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.673092] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.673235] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.673321] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.673515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.673618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.673728] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 is going to be updated. [ 1288.712999] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.713304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.713385] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.713633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.713838] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.744856] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: IN_PROGRESS for 2s [ 1289.357687] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: SUCCESS [ 1289.357687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.692696] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: SUCCESS [ 1289.693182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.749645] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1289.749857] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.759223] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: SUCCESS [ 1289.759451] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.767952] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1289.768172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.874826] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1289.874973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.875288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.875397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.875766] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.875766] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.875882] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.876074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.876130] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.876184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.876263] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.378320] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.754725] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30740e8f-2016-47cb-9949-af7efd303581 in Status: SUCCESS [ 1290.755075] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30740e8f-2016-47cb-9949-af7efd303581 deletion is rescheduled due to dependency. [ 1290.755075] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30740e8f-2016-47cb-9949-af7efd303581" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.881113] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4314113-ddb6-40ad-8c52-48dfb885822e: rpc.has_security_group_logging(os_id): False [ 1290.900740] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.900908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.900982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.901216] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.920749] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.921054] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.921177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.921244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.921440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.921523] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.921610] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1290.977710] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.977937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.977937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.978125] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.978276] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.988665] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1293.008309] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1293.008704] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.008757] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.009040] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.009130] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.167831] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.168024] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1293.511559] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.511761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.511761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.511986] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.512181] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.512282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.512345] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.512491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.512578] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.512663] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.512754] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.015320] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.518227] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4314113-ddb6-40ad-8c52-48dfb885822e: rpc.has_security_group_logging(os_id): False [ 1294.542516] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.542689] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.542921] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.543616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.543616] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.543616] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.543796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.543796] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.543940] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.544035] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.544128] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1294.744170] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.744332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.744332] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.744615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.744765] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.761138] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1296.780095] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1296.780403] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.168713] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.169263] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.170438] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.170706] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1306.967430] env[66131]: INFO networking_nsxv3.common.synchronization [req-97ef1092-88c1-499b-8584-d28ac6f8ec62 req-0e74b32d-7dfd-486c-8edd-a70db9b964fa tempest-ServerActionsV293TestJSON-1005479135 tempest-ServerActionsV293TestJSON-1005479135-project-member] Enqueued Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_members [ 1306.968257] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 with Priority: HIGHEST for action security_group_members [ 1306.968703] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.968942] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.971071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.971310] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.971492] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.971606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.971678] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.971843] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.971931] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.972057] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28ee1eeb-3432-45a9-a6f2-8c319e5f2db4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.087554] env[66131]: INFO networking_nsxv3.common.synchronization [req-3ecde8cf-2111-47b2-bd99-995e02cf46dd req-931e5af3-33dd-4856-8b63-a4d5bf9a52d1 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1307.088349] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1307.088682] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.088800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.088866] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.089103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.089258] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.089356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.089416] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.089555] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.089638] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.089727] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.474587] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.474729] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.474802] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.475029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.475122] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.475406] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.475406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.475551] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.475636] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.475674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.475752] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 is going to be updated. [ 1307.510647] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.510793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.510862] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.511076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.511219] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.520134] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: IN_PROGRESS for 2s [ 1307.592596] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.095445] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.598627] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.598869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.598869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.599274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.599498] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.599498] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1308.662570] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.662832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.662832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.663022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.663172] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.674104] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1309.531461] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 in Status: SUCCESS [ 1309.531773] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28ee1eeb-3432-45a9-a6f2-8c319e5f2db4 deletion is rescheduled due to dependency. [ 1309.531808] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28ee1eeb-3432-45a9-a6f2-8c319e5f2db4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.685762] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1310.685762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.089602] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.089949] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.908317] env[66131]: INFO networking_nsxv3.common.synchronization [req-cf07fb87-42b7-4d80-a0c7-a30eb69c7adf req-1dca6e2e-79e3-457c-a2b5-2f9185dd7e87 tempest-AttachVolumeNegativeTest-1672690184 tempest-AttachVolumeNegativeTest-1672690184-project-member] Enqueued Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_members [ 1316.908965] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3524095-a1d8-4e89-823e-93c3b176609b with Priority: HIGHEST for action security_group_members [ 1316.909301] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3524095-a1d8-4e89-823e-93c3b176609b taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.909750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.909750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.909750] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.909945] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.909945] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.910136] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.910187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.910237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.910326] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3524095-a1d8-4e89-823e-93c3b176609b',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.413179] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.413380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.413380] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.413573] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.413673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.413873] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.413973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.414050] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.414204] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.414283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.414369] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3524095-a1d8-4e89-823e-93c3b176609b is going to be updated. [ 1317.442259] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.442566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.442566] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.442764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.442827] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.450807] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: IN_PROGRESS for 2s [ 1319.461151] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3524095-a1d8-4e89-823e-93c3b176609b in Status: SUCCESS [ 1319.461525] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3524095-a1d8-4e89-823e-93c3b176609b deletion is rescheduled due to dependency. [ 1319.461525] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3524095-a1d8-4e89-823e-93c3b176609b" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.910313] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.910749] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.769058] env[66131]: INFO networking_nsxv3.common.synchronization [req-505be14e-94d1-4215-aea5-0a671391b221 req-ff57f56b-8c6c-4dd3-bb6a-64e7c9ac8750 tempest-ServerActionsTestOtherA-559185100 tempest-ServerActionsTestOtherA-559185100-project-member] Enqueued Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1322.769644] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 with Priority: HIGHEST for action security_group_members [ 1322.770030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.770155] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.770222] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.770425] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.770574] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.770666] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.770726] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.770869] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.770955] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.771059] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68adb37-f05f-44c4-a13b-7eb7bc0ab766',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.273951] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.274409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.274409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.274409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.274524] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.274696] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.274799] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.274861] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.275022] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.275097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.275182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 is going to be updated. [ 1323.307251] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.307479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.307479] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.307659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.307805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.315964] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: IN_PROGRESS for 2s [ 1325.326364] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 in Status: SUCCESS [ 1325.326761] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68adb37-f05f-44c4-a13b-7eb7bc0ab766 deletion is rescheduled due to dependency. [ 1325.326761] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68adb37-f05f-44c4-a13b-7eb7bc0ab766" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.771116] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.771492] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.203932] env[66131]: INFO networking_nsxv3.common.synchronization [None req-4960a545-f2ee-402f-ad6d-fb526f6ccf1f None None] Enqueued Resource ID: f5e09b90-adad-4ae3-9f12-77dbde759aa4 with Priority: HIGHEST for action port [ 1331.204587] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e09b90-adad-4ae3-9f12-77dbde759aa4 with Priority: HIGHEST for action port [ 1331.205129] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e09b90-adad-4ae3-9f12-77dbde759aa4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.205886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e09b90-adad-4ae3-9f12-77dbde759aa4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.205886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e09b90-adad-4ae3-9f12-77dbde759aa4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.205886] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e09b90-adad-4ae3-9f12-77dbde759aa4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.205886] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e09b90-adad-4ae3-9f12-77dbde759aa4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.712745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5e09b90-adad-4ae3-9f12-77dbde759aa4 [ 1331.712745] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.712745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.712745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.712745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.712745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.712745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5e09b90-adad-4ae3-9f12-77dbde759aa4 already deleted. [ 1331.712745] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e09b90-adad-4ae3-9f12-77dbde759aa4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.174156] env[66131]: INFO networking_nsxv3.common.synchronization [None req-c5d7825b-11ac-4668-8072-4e54744e7643 None None] Enqueued Resource ID: 68b214af-63d5-4677-8974-7e4358aaf6f4 with Priority: HIGHEST for action port [ 1333.175039] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b214af-63d5-4677-8974-7e4358aaf6f4 with Priority: HIGHEST for action port [ 1333.175039] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-68b214af-63d5-4677-8974-7e4358aaf6f4 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.175248] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68b214af-63d5-4677-8974-7e4358aaf6f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.175322] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68b214af-63d5-4677-8974-7e4358aaf6f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.175590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68b214af-63d5-4677-8974-7e4358aaf6f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.175678] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68b214af-63d5-4677-8974-7e4358aaf6f4',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.678486] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68b214af-63d5-4677-8974-7e4358aaf6f4 [ 1333.678486] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.678742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.678742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.678889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.678939] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.679034] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68b214af-63d5-4677-8974-7e4358aaf6f4 already deleted. [ 1333.679236] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68b214af-63d5-4677-8974-7e4358aaf6f4" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.160894] env[66131]: INFO networking_nsxv3.common.synchronization [req-8deb04b4-e431-457f-9a1e-d8cfad47ccb4 req-9a76359b-17a4-4e17-a010-da6f518906a7 tempest-ServerAddressesTestJSON-663225157 tempest-ServerAddressesTestJSON-663225157-project-member] Enqueued Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_members [ 1338.163659] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_members [ 1338.164090] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.164220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.164284] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.164517] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.164674] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.164775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.164831] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.164974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.165074] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.165173] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.445777] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.445989] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-999" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.446124] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-999" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.446522] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-999" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.446819] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.446996] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.447126] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.447350] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.447497] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.447704] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1338.447814] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1338.447920] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1338.448034] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1338.448142] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1338.448244] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1338.448425] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1338.468906] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1338.469143] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1338.469219] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1338.469373] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-999" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.469682] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-b0bfefa6-3752-413d-afe3-411703a34d31 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.469849] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.469967] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.470321] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.470461] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0bfefa6-3752-413d-afe3-411703a34d31',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.667030] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.667261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.667308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.667687] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.667818] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.668080] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.668244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.668358] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.668569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.668679] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.668822] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d already deleted. [ 1338.668964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.973158] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.973394] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.973451] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.973718] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.973869] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.974031] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port b0bfefa6-3752-413d-afe3-411703a34d31 not found, creating... [ 1338.974305] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.974457] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.974571] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.974796] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.974928] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.975234] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.975385] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.975501] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.975703] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.975836] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.975974] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: b0bfefa6-3752-413d-afe3-411703a34d31 is going to be created. [ 1338.996782] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.997015] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.997098] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.997362] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.997592] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.997813] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.696090] env[66131]: INFO networking_nsxv3.common.synchronization [req-8deb04b4-e431-457f-9a1e-d8cfad47ccb4 req-5bee39df-af3f-4f13-8992-ffd4b521ea0f service nova] Enqueued Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_rules [ 1339.696380] env[66131]: INFO networking_nsxv3.common.synchronization [req-8deb04b4-e431-457f-9a1e-d8cfad47ccb4 req-5bee39df-af3f-4f13-8992-ffd4b521ea0f service nova] Enqueued Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_members [ 1339.696467] env[66131]: INFO networking_nsxv3.common.synchronization [req-8deb04b4-e431-457f-9a1e-d8cfad47ccb4 req-5bee39df-af3f-4f13-8992-ffd4b521ea0f service nova] Enqueued Resource ID: b0bfefa6-3752-413d-afe3-411703a34d31 with Priority: HIGHEST for action port [ 1339.696702] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_rules [ 1339.696827] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_members [ 1339.696920] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0bfefa6-3752-413d-afe3-411703a34d31 with Priority: HIGHEST for action port [ 1339.697469] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.697591] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.697707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.697911] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.697997] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.699670] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.699670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.699670] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.699807] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.699917] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.700054] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.700144] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.700315] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.700427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.700549] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.701446] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0bfefa6-3752-413d-afe3-411703a34d31 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.701446] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.701606] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.701707] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.702330] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0bfefa6-3752-413d-afe3-411703a34d31',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.203730] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.204801] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.204910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.205086] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0bfefa6-3752-413d-afe3-411703a34d31 with status ACTIVE [ 1340.205247] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.205349] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.205466] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.205611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.205702] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.205899] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.205998] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.206065] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.206237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.206320] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.206503] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.206700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.206700] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.206858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.206858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.206933] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0bfefa6-3752-413d-afe3-411703a34d31 is going to be updated. [ 1340.229829] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.229996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.230053] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.230261] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.230409] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.230569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0bfefa6-3752-413d-afe3-411703a34d31" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.708810] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.211026] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.211247] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.211325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.211716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.211822] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.211941] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d is going to be created. [ 1341.243045] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.243045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.243045] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.243375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.243375] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.253601] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d in Status: UNINITIALIZED for 2s [ 1343.266293] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d in Status: SUCCESS [ 1343.266682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.266682] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.266910] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.267131] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.267268] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.267347] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.267520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.267633] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.267730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.267827] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.770561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.770868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.770868] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.771080] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.771317] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.771445] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.771540] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.772162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.772288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.772386] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.772599] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.772748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.772819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.772968] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.773161] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.773255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.773335] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.773488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.773569] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.773709] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.773807] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.276580] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2673c9d3-40a4-4d53-b0eb-f028b5174f7d: rpc.has_security_group_logging(os_id): False [ 1344.294477] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.294741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.294741] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.294854] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.294891] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.295126] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.295237] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.295300] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.295456] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.295533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.295726] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.295817] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.295875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.296025] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.296103] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.296284] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.296387] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.296447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.296575] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.296647] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.296730] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d is going to be created. [ 1344.361208] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.361458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.361458] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.361609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.361788] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.372709] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d in Status: IN_PROGRESS for 2s [ 1344.697712] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.697892] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1344.944475] env[66131]: INFO networking_nsxv3.common.synchronization [req-854ea6f0-1887-4402-b153-38f3c7196b9f req-c0f79178-097f-4390-a6b8-e605bedea856 tempest-AttachVolumeTestJSON-957958118 tempest-AttachVolumeTestJSON-957958118-project-member] Enqueued Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_members [ 1344.944475] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 with Priority: HIGHEST for action security_group_members [ 1344.944475] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.944475] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.944747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.944747] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.944876] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.944973] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.945246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.945366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.945453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.945547] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.447583] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.447995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.447995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.447995] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.448133] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.448310] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.448519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.448519] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.448642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.448722] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.448807] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 is going to be updated. [ 1345.477302] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.477549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.477549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.477694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.477836] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.486358] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: IN_PROGRESS for 2s [ 1346.393598] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d in Status: SUCCESS [ 1346.393598] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.497784] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 in Status: SUCCESS [ 1347.498195] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9 deletion is rescheduled due to dependency. [ 1347.498195] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd6462d0-c8a6-4ae9-aeb2-9e28a154b8a9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.740302] env[66131]: INFO networking_nsxv3.common.synchronization [req-e132fd23-ad0c-4914-be39-a21a1090e3c4 req-d9632cca-6e87-4860-95b9-7b685fc151cb tempest-ServerAddressesTestJSON-663225157 tempest-ServerAddressesTestJSON-663225157-project-member] Enqueued Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_members [ 1349.741268] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d with Priority: HIGHEST for action security_group_members [ 1349.741268] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.742141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.742141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.742141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.742141] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.742141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.742141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.742141] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.742401] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.742401] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2673c9d3-40a4-4d53-b0eb-f028b5174f7d',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.244951] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.245189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.245189] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.245404] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.245499] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.245733] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.245837] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.245900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.246076] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.246157] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.246245] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d is going to be updated. [ 1350.277336] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.277565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.277609] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.277790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.277935] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.288132] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d in Status: IN_PROGRESS for 2s [ 1352.300286] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d in Status: SUCCESS [ 1352.300735] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2673c9d3-40a4-4d53-b0eb-f028b5174f7d deletion is rescheduled due to dependency. [ 1352.300735] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2673c9d3-40a4-4d53-b0eb-f028b5174f7d" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.742474] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.742474] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.872202] env[66131]: INFO networking_nsxv3.common.synchronization [None req-5bd9bc98-1818-48fc-b774-9c74ef1fdf82 None None] Enqueued Resource ID: 39b5a485-cf1b-4525-9892-cfaa59855cf6 with Priority: HIGHEST for action port [ 1357.872202] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b5a485-cf1b-4525-9892-cfaa59855cf6 with Priority: HIGHEST for action port [ 1357.872202] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b5a485-cf1b-4525-9892-cfaa59855cf6 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.872628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b5a485-cf1b-4525-9892-cfaa59855cf6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.872628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b5a485-cf1b-4525-9892-cfaa59855cf6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.872628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b5a485-cf1b-4525-9892-cfaa59855cf6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.872879] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b5a485-cf1b-4525-9892-cfaa59855cf6',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.374737] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39b5a485-cf1b-4525-9892-cfaa59855cf6 [ 1358.374990] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.375143] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.375212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.375481] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.375748] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.375748] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39b5a485-cf1b-4525-9892-cfaa59855cf6 already deleted. [ 1358.375890] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b5a485-cf1b-4525-9892-cfaa59855cf6" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.674501] env[66131]: INFO networking_nsxv3.common.synchronization [None req-bec667cd-757c-416b-82ae-6ed33d7d55d4 None None] Enqueued Resource ID: 1c225ccd-971a-4ba4-9aad-d4550f3ded05 with Priority: HIGHEST for action port [ 1359.675782] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c225ccd-971a-4ba4-9aad-d4550f3ded05 with Priority: HIGHEST for action port [ 1359.675782] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c225ccd-971a-4ba4-9aad-d4550f3ded05 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.675782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c225ccd-971a-4ba4-9aad-d4550f3ded05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.675782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c225ccd-971a-4ba4-9aad-d4550f3ded05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.675782] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c225ccd-971a-4ba4-9aad-d4550f3ded05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.675782] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c225ccd-971a-4ba4-9aad-d4550f3ded05',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.178162] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c225ccd-971a-4ba4-9aad-d4550f3ded05 [ 1360.178411] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.178571] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.178645] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.178865] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.178960] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.179070] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c225ccd-971a-4ba4-9aad-d4550f3ded05 already deleted. [ 1360.179153] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c225ccd-971a-4ba4-9aad-d4550f3ded05" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.896566] env[66131]: INFO networking_nsxv3.common.synchronization [req-473f2cd1-ba33-4110-a3da-b71017d9748b req-f940220f-b5a8-4d39-9e72-d136a5f19113 tempest-ServerPasswordTestJSON-506234763 tempest-ServerPasswordTestJSON-506234763-project-member] Enqueued Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_members [ 1362.897124] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_members [ 1362.897436] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.897560] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.897630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.897930] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.898104] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.898203] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.898271] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.898417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.898503] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.898624] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.202091] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock network-372 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.202346] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "network-372" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.202501] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "network-372" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.202848] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "network-372" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.203157] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.203367] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.203516] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.203764] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.203940] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.204193] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1363.204336] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1363.204469] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1363.204600] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1363.204845] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1363.205008] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1363.205155] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1363.225845] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1363.226051] env[66131]: DEBUG dogpile.cache.region [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1363.226164] env[66131]: DEBUG dogpile.lock [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1363.226340] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "network-372" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.226711] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock port-0afaef87-a2a3-4d6c-8d04-2f7626615e44 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.226890] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.227019] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.227338] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.227475] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afaef87-a2a3-4d6c-8d04-2f7626615e44',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.401250] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.401418] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.401488] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.401723] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.401819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.402050] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.402127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.402175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.402325] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.402402] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.402486] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 already deleted. [ 1363.402567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.729560] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.729837] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.729979] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.730283] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.730435] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.730591] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Segment Port 0afaef87-a2a3-4d6c-8d04-2f7626615e44 not found, creating... [ 1363.730912] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.731094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.731210] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.731449] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.731590] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.731921] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.732094] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.732211] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.732423] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.732556] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.732705] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Resource: SegmentPort with ID: 0afaef87-a2a3-4d6c-8d04-2f7626615e44 is going to be created. [ 1363.756331] env[66131]: DEBUG networking_nsxv3.common.locking [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.756567] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.756704] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.756989] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.757236] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.757459] env[66131]: DEBUG oslo_concurrency.lockutils [None req-a8c6ef31-b58f-47c7-9619-a60e9ddc8e4d None None] Releasing lock "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.440400] env[66131]: INFO networking_nsxv3.common.synchronization [req-473f2cd1-ba33-4110-a3da-b71017d9748b req-036b292e-71b4-4b64-a8d9-cacae1b95d1e service nova] Enqueued Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_rules [ 1364.440772] env[66131]: INFO networking_nsxv3.common.synchronization [req-473f2cd1-ba33-4110-a3da-b71017d9748b req-036b292e-71b4-4b64-a8d9-cacae1b95d1e service nova] Enqueued Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_members [ 1364.440772] env[66131]: INFO networking_nsxv3.common.synchronization [req-473f2cd1-ba33-4110-a3da-b71017d9748b req-036b292e-71b4-4b64-a8d9-cacae1b95d1e service nova] Enqueued Resource ID: 0afaef87-a2a3-4d6c-8d04-2f7626615e44 with Priority: HIGHEST for action port [ 1364.441247] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_rules [ 1364.441388] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_members [ 1364.441483] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0afaef87-a2a3-4d6c-8d04-2f7626615e44 with Priority: HIGHEST for action port [ 1364.441747] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.441916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.441916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.442197] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.442278] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.443089] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.443206] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.443279] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.443426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.443561] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.443656] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.443718] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.443881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.443929] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.444026] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.444709] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0afaef87-a2a3-4d6c-8d04-2f7626615e44 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.444814] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.444881] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.445028] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.445103] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afaef87-a2a3-4d6c-8d04-2f7626615e44',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.947742] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.947742] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.947742] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.948695] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0afaef87-a2a3-4d6c-8d04-2f7626615e44 with status ACTIVE [ 1364.948879] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.948981] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.949064] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.949273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.949355] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.949522] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.949649] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.949730] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.949900] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.950554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.950554] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.950554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.950554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.950554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.950554] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.950922] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0afaef87-a2a3-4d6c-8d04-2f7626615e44 is going to be updated. [ 1364.972368] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.972563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.972563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.972762] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.972898] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.973066] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0afaef87-a2a3-4d6c-8d04-2f7626615e44" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.452260] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.874246] env[66131]: INFO networking_nsxv3.common.synchronization [req-51a4e758-b62e-482c-be18-1112f449a040 req-36d119e7-0c9c-4f38-9978-bf3f7348ae65 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1365.874246] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1365.874246] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.874246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.874246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.874246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.874246] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.874533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.874533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.874533] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.874626] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.874746] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.955701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.955701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.955701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.955701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.955701] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.955701] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 is going to be created. [ 1365.980929] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.981152] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.981225] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.981453] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.981613] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.992433] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 in Status: UNINITIALIZED for 2s [ 1366.376793] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.376976] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.377036] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.377255] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.377348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.377540] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.377641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.377696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.377832] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.377906] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.377988] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1366.406535] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.406819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.406819] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.406944] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.407102] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.468066] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1368.002182] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 in Status: SUCCESS [ 1368.002182] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.002562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.002562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.003433] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.003433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.003433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.003433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.003433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.003433] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.003433] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.478622] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1368.478845] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e deletion is rescheduled due to dependency. [ 1368.478975] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.505678] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.505924] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.505974] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.506233] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.506413] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.506618] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.506693] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.506805] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.506991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.507073] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.507197] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.507309] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.507373] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.507520] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.507685] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.507880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.507880] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.508072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.508072] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.508168] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.508246] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.011047] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da6a108e-b9e7-4f55-b2f8-1b03aff602a8: rpc.has_security_group_logging(os_id): False [ 1369.028989] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.029209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.029209] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.029346] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.029440] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.029625] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.029737] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.029777] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.029916] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.029992] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.030206] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.030304] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.030366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.030532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.030601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.030794] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.030887] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.030964] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.031113] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.031177] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.031264] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 is going to be created. [ 1369.090977] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.091238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.091238] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.091408] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.091586] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.102774] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 in Status: IN_PROGRESS for 2s [ 1370.874662] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.875193] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1371.115281] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 in Status: SUCCESS [ 1371.115493] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.938661] env[66131]: INFO networking_nsxv3.common.synchronization [req-a13b253e-f845-4f53-af13-24250f8356ae req-c3e22ed7-fa61-4572-a2af-13143edf9597 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1372.940417] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1372.940417] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.940417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.940417] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.940641] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.941424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.941424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.941424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.941424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.941720] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.942713] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.208798] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.208988] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.210034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.210034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.210034] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.210034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.210034] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.210640] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.210832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.211064] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1373.211181] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1373.211293] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1373.211400] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1373.211509] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1373.211614] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1373.211742] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1373.239561] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1373.239561] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1373.239827] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1373.239914] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-555" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.240282] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-0ea10ebd-8856-495d-aa6a-93d817b32e29 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.240462] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.240586] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.240957] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.241113] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ea10ebd-8856-495d-aa6a-93d817b32e29',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.445621] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.445908] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.445962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.446241] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.446344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.446550] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.446642] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.446717] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.446858] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.446928] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.447034] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1373.478658] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.478920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.478920] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.479162] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.479344] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.488667] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1373.743288] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.743554] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.743682] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.743992] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.744167] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.744324] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port 0ea10ebd-8856-495d-aa6a-93d817b32e29 not found, creating... [ 1373.744578] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.744734] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.744852] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.745111] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.745250] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.745530] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.745706] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.745824] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.746068] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.746212] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.746353] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: 0ea10ebd-8856-495d-aa6a-93d817b32e29 is going to be created. [ 1373.769408] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.769610] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.769778] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.770104] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.770340] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.770565] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.092624] env[66131]: INFO networking_nsxv3.common.synchronization [req-589fb0bf-1bc2-423f-80d9-95ce1412dd2e req-1ee6fabf-ee03-4bd7-8168-52cf6b91681d tempest-ServerPasswordTestJSON-506234763 tempest-ServerPasswordTestJSON-506234763-project-member] Enqueued Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_members [ 1374.093175] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 with Priority: HIGHEST for action security_group_members [ 1374.093476] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.093631] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.093696] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.093883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.094136] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.094242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.094242] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.094406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.094491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.094581] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da6a108e-b9e7-4f55-b2f8-1b03aff602a8',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.445295] env[66131]: INFO networking_nsxv3.common.synchronization [req-a13b253e-f845-4f53-af13-24250f8356ae req-944c9734-68c6-46d9-b186-e5758c195a10 service nova] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 1374.445498] env[66131]: INFO networking_nsxv3.common.synchronization [req-a13b253e-f845-4f53-af13-24250f8356ae req-944c9734-68c6-46d9-b186-e5758c195a10 service nova] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1374.445651] env[66131]: INFO networking_nsxv3.common.synchronization [req-a13b253e-f845-4f53-af13-24250f8356ae req-944c9734-68c6-46d9-b186-e5758c195a10 service nova] Enqueued Resource ID: 0ea10ebd-8856-495d-aa6a-93d817b32e29 with Priority: HIGHEST for action port [ 1374.446147] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_rules [ 1374.446288] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1374.446374] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ea10ebd-8856-495d-aa6a-93d817b32e29 with Priority: HIGHEST for action port [ 1374.446739] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.446825] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.446883] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.447549] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.447640] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.449029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.449029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.449029] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ea10ebd-8856-495d-aa6a-93d817b32e29 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.449029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.449029] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.449317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.449317] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ea10ebd-8856-495d-aa6a-93d817b32e29',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.596853] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.597071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.597071] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.597273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.597366] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.597557] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.597658] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.597740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.597904] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.597982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.598083] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 is going to be updated. [ 1374.624785] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.624991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.624991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.625218] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.625364] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.633753] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 in Status: IN_PROGRESS for 2s [ 1374.952054] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.952269] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.952536] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ea10ebd-8856-495d-aa6a-93d817b32e29 with status ACTIVE [ 1374.952654] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.952719] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.952773] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.952934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.953046] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.953216] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.953370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.953406] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.953534] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.953659] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.953785] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.953875] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.953934] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.954084] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.954158] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.954239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ea10ebd-8856-495d-aa6a-93d817b32e29 is going to be updated. [ 1374.975395] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.975596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.975596] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.975775] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.975912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.976108] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ea10ebd-8856-495d-aa6a-93d817b32e29" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.498586] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1375.498924] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e deletion is rescheduled due to dependency. [ 1375.498962] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.499126] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.499411] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.499618] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.499790] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.499873] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.500117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.500228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.500346] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.003058] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.504907] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.643326] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 in Status: SUCCESS [ 1376.643555] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da6a108e-b9e7-4f55-b2f8-1b03aff602a8 deletion is rescheduled due to dependency. [ 1376.643674] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da6a108e-b9e7-4f55-b2f8-1b03aff602a8" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.007801] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.007971] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.008063] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.008397] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.008500] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.008644] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1377.038907] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.039101] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.039266] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.039497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.039708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.052375] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1379.063306] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1379.063306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.063306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.063306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.063306] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.063306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.063306] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.064119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.064119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.064119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.064119] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.447060] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.447191] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1379.566409] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.068970] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4314113-ddb6-40ad-8c52-48dfb885822e: rpc.has_security_group_logging(os_id): False [ 1380.087057] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.087220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.087220] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.087447] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.087518] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.087764] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.087907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.087907] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.088100] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.088180] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.088266] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1380.153610] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.153764] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.153860] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.154098] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.154253] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.170252] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1382.178568] env[66131]: INFO networking_nsxv3.common.synchronization [None req-bf67b055-55de-4330-97ef-8f931bc24d41 None None] Enqueued Resource ID: 3afddec5-bf25-479e-a3f9-91ab9836a80c with Priority: HIGHEST for action port [ 1382.179490] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afddec5-bf25-479e-a3f9-91ab9836a80c with Priority: HIGHEST for action port [ 1382.179778] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-3afddec5-bf25-479e-a3f9-91ab9836a80c taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.180033] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3afddec5-bf25-479e-a3f9-91ab9836a80c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.180110] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3afddec5-bf25-479e-a3f9-91ab9836a80c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.180374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3afddec5-bf25-479e-a3f9-91ab9836a80c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.180452] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3afddec5-bf25-479e-a3f9-91ab9836a80c',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.187384] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1382.187384] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.682239] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3afddec5-bf25-479e-a3f9-91ab9836a80c [ 1382.682424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.682581] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.682793] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.682872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.683441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.683441] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3afddec5-bf25-479e-a3f9-91ab9836a80c already deleted. [ 1382.683441] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3afddec5-bf25-479e-a3f9-91ab9836a80c" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.841362] env[66131]: INFO networking_nsxv3.common.synchronization [None req-abec70ee-1d04-4cd4-a869-1b8f671684bd None None] Enqueued Resource ID: f91a5f21-616c-4927-845f-de21e18f15a2 with Priority: HIGHEST for action port [ 1383.841362] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91a5f21-616c-4927-845f-de21e18f15a2 with Priority: HIGHEST for action port [ 1383.841362] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91a5f21-616c-4927-845f-de21e18f15a2 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.841362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91a5f21-616c-4927-845f-de21e18f15a2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.841362] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91a5f21-616c-4927-845f-de21e18f15a2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.842756] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91a5f21-616c-4927-845f-de21e18f15a2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.843164] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91a5f21-616c-4927-845f-de21e18f15a2',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.345150] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f91a5f21-616c-4927-845f-de21e18f15a2 [ 1384.345358] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.345491] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.345630] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.346117] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.346228] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.346328] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f91a5f21-616c-4927-845f-de21e18f15a2 already deleted. [ 1384.346567] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91a5f21-616c-4927-845f-de21e18f15a2" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.730941] env[66131]: INFO networking_nsxv3.common.synchronization [None req-cd7ba52f-35bc-45de-8bfa-e2babed51391 None None] Enqueued Resource ID: 410d741f-0830-44c1-b060-2de995c3fe96 with Priority: HIGHEST for action port [ 1384.731598] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 410d741f-0830-44c1-b060-2de995c3fe96 with Priority: HIGHEST for action port [ 1384.732046] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-410d741f-0830-44c1-b060-2de995c3fe96 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.732282] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-410d741f-0830-44c1-b060-2de995c3fe96" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.732356] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-410d741f-0830-44c1-b060-2de995c3fe96" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.732716] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-410d741f-0830-44c1-b060-2de995c3fe96" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.732969] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('410d741f-0830-44c1-b060-2de995c3fe96',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.235166] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 410d741f-0830-44c1-b060-2de995c3fe96 [ 1385.235410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.235547] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.235611] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.235821] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.235912] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.236015] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:410d741f-0830-44c1-b060-2de995c3fe96 already deleted. [ 1385.236097] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-410d741f-0830-44c1-b060-2de995c3fe96" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.883561] env[66131]: INFO networking_nsxv3.common.synchronization [None req-2911ef49-1748-446f-9fa0-0ea004c9ebf0 None None] Enqueued Resource ID: e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9 with Priority: HIGHEST for action port [ 1385.884124] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9 with Priority: HIGHEST for action port [ 1385.884434] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.884558] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.884624] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.884969] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.884969] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.387263] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9 [ 1386.387601] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.387669] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.387708] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.387957] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.388091] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.388191] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9 already deleted. [ 1386.388274] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5e314a5-9f70-4a5f-9d65-64f6b7a7dce9" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.200510] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc14611d-87e7-44e0-9da9-7e865edc0523 req-ce1beb5e-34ac-4b84-b80c-90e8f2fd907a tempest-ServersNegativeTestMultiTenantJSON-188059753 tempest-ServersNegativeTestMultiTenantJSON-188059753-project-member] Enqueued Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_members [ 1389.201065] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_members [ 1389.201424] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.201563] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.201629] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.201937] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.202242] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.202361] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.202427] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.202590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.202677] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.202773] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.482625] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.482832] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "network-954" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.482954] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "network-954" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.483306] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "network-954" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.483558] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.483716] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.483831] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.484056] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.484200] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.484429] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1389.484546] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] NeedRegenerationException {{(pid=66131) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1389.484651] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] no value, waiting for create lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1389.484758] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] value creation lock acquired {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1389.484866] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] No value present for key: 'zone-id' {{(pid=66131) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1389.484982] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Calling creation function for not-yet-present value {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1389.485150] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1389.506289] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1389.506467] env[66131]: DEBUG dogpile.cache.region [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66131) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1389.506579] env[66131]: DEBUG dogpile.lock [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Released creation lock {{(pid=66131) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1389.506830] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "network-954" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.507139] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3 taken with stack trace [, , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.507313] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.507434] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.507802] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.507943] env[66131]: DEBUG networking_nsxv3.api.rpc [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2c0ab65-b400-4c5f-92a7-7000d92f49f3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.707025] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.707212] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.707286] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.707497] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.707590] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.707782] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.707876] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.707938] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.708093] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.708170] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.708253] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea already deleted. [ 1389.708334] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.010080] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.010291] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.010417] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.010690] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.010840] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.010994] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Segment Port a2c0ab65-b400-4c5f-92a7-7000d92f49f3 not found, creating... [ 1390.011275] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.011430] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.011546] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.011756] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.011891] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.012181] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.012334] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.012447] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.012641] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.012769] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.012904] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Resource: SegmentPort with ID: a2c0ab65-b400-4c5f-92a7-7000d92f49f3 is going to be created. [ 1390.034024] env[66131]: DEBUG networking_nsxv3.common.locking [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.034308] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.034395] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.034617] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.034843] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.035078] env[66131]: DEBUG oslo_concurrency.lockutils [None req-9c9c0442-2a51-4fb2-b795-0a959cf8ffff None None] Releasing lock "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.721806] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc14611d-87e7-44e0-9da9-7e865edc0523 req-cdf8275f-0488-427f-b1b6-8c257c9aee75 service nova] Enqueued Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_rules [ 1390.722052] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc14611d-87e7-44e0-9da9-7e865edc0523 req-cdf8275f-0488-427f-b1b6-8c257c9aee75 service nova] Enqueued Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_members [ 1390.722128] env[66131]: INFO networking_nsxv3.common.synchronization [req-bc14611d-87e7-44e0-9da9-7e865edc0523 req-cdf8275f-0488-427f-b1b6-8c257c9aee75 service nova] Enqueued Resource ID: a2c0ab65-b400-4c5f-92a7-7000d92f49f3 with Priority: HIGHEST for action port [ 1390.722683] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_rules [ 1390.722823] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_members [ 1390.722922] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c0ab65-b400-4c5f-92a7-7000d92f49f3 with Priority: HIGHEST for action port [ 1390.723209] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.723308] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.723374] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.723615] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.723714] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.724525] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.724639] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.724705] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.724872] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.725038] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.725119] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.725184] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.725370] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.725461] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.725551] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.726422] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3 taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.726528] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.726599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.726771] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.726851] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2c0ab65-b400-4c5f-92a7-7000d92f49f3',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.228916] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.230476] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.230634] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.230745] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2c0ab65-b400-4c5f-92a7-7000d92f49f3 with status ACTIVE [ 1391.230914] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.231027] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.231079] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.231288] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.231348] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.231510] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.231597] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.231654] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.231794] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.231893] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.232050] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.232254] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.232353] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.232452] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.232486] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.232579] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2c0ab65-b400-4c5f-92a7-7000d92f49f3 is going to be updated. [ 1391.255387] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.255673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.255673] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.255848] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.255997] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.256169] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2c0ab65-b400-4c5f-92a7-7000d92f49f3" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.734900] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.236701] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.236889] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.236965] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.237192] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.237283] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.237382] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea is going to be created. [ 1392.262410] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.262628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.262628] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.262823] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.262980] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.272327] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea in Status: UNINITIALIZED for 2s [ 1394.282267] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea in Status: SUCCESS [ 1394.282694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.282694] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.282855] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.283065] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.283175] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.283246] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.283391] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.283471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.283557] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.283645] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.785824] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.786094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.786094] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.786483] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.786582] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.786685] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.786772] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.786996] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.787127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.787258] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.787459] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.787661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.787661] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.787800] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.787981] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.788127] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.788208] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.788363] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.788471] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.788564] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.788658] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.291399] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea: rpc.has_security_group_logging(os_id): False [ 1395.308481] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.308734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.308734] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.308991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.309118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.309294] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.309424] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.309522] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.309594] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.309655] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.309841] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.309923] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.309982] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.310244] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.310301] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.310476] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.310562] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.310619] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.310755] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.310829] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.310912] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea is going to be created. [ 1395.367179] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.367420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.367420] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.367601] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.367779] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.378847] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea in Status: IN_PROGRESS for 2s [ 1395.724649] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.724904] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1397.391966] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea in Status: SUCCESS [ 1397.391966] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.725400] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.725780] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.530138] env[66131]: INFO networking_nsxv3.common.synchronization [req-b85a084b-6828-4d89-8b37-785e520f5375 req-ec30dad6-4051-4523-bf22-c00aecc90722 tempest-ServersNegativeTestMultiTenantJSON-188059753 tempest-ServersNegativeTestMultiTenantJSON-188059753-project-member] Enqueued Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_members [ 1401.530686] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea with Priority: HIGHEST for action security_group_members [ 1401.530994] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.531273] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.531333] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.531515] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.531767] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.531767] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.531892] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.531978] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.532129] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.532226] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.035169] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.035699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.035699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.035699] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.035809] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.035946] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.036118] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.036194] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.036291] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.036371] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.036462] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea is going to be updated. [ 1402.064439] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.064650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.064650] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.064850] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.064991] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.074377] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea in Status: IN_PROGRESS for 2s [ 1404.087170] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea in Status: SUCCESS [ 1404.087593] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea deletion is rescheduled due to dependency. [ 1404.087593] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc0ee4f-3e3b-4da0-ae28-cdea2e5f79ea" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.532353] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.532353] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.533574] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.534038] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.534972] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.535475] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.536351] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.536759] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.538051] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.538470] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.539401] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.539695] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.484858] env[66131]: INFO networking_nsxv3.common.synchronization [req-bba7dbd8-8cc8-4c82-b0d6-35837ebb42fb req-0fabb8ba-1d2b-41b5-a23e-03e2d9f70249 tempest-ServerActionsTestJSON-237496815 tempest-ServerActionsTestJSON-237496815-project-member] Enqueued Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1436.485435] env[66131]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4314113-ddb6-40ad-8c52-48dfb885822e with Priority: HIGHEST for action security_group_members [ 1436.485806] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4314113-ddb6-40ad-8c52-48dfb885822e taken with stack trace [, , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.485993] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.486234] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.486489] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.486847] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.487021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.487021] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.487187] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.487317] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.487424] env[66131]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4314113-ddb6-40ad-8c52-48dfb885822e',) {} {{(pid=66131) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.990338] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.990565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.990565] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.990740] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.990834] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.991043] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.991142] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.991250] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.991352] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.991426] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.991509] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e is going to be updated. [ 1437.022298] env[66131]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66131) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.022532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.022532] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.022714] env[66131]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.022852] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.030854] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: IN_PROGRESS for 2s [ 1439.042187] env[66131]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4314113-ddb6-40ad-8c52-48dfb885822e in Status: SUCCESS [ 1439.042599] env[66131]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4314113-ddb6-40ad-8c52-48dfb885822e deletion is rescheduled due to dependency. [ 1439.042599] env[66131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4314113-ddb6-40ad-8c52-48dfb885822e" {{(pid=66131) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.486372] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.486721] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.487531] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.487908] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.488359] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.488729] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.490142] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.490142] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.490979] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.491437] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.492614] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.493132] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.493503] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.493982] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.495072] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.495480] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.496690] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.497087] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.768918] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1485.769295] env[66131]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-5004a8f5-9220-484d-9816-181324c52cea None None] NSXv3 Agent Agent loop - iteration:4 started [ 1486.498086] env[66131]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.498262] env[66131]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0